-- Logs begin at Fri 2022-10-14 02:17:41 UTC, end at Fri 2022-10-14 03:23:27 UTC. -- Oct 14 02:48:02.847130 dv-cinder-801522-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 14 02:48:02.855866 dv-cinder-801522-13-smb devstack@keystone.service[81500]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 02:48:02 2022] *** Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: nodename: dv-cinder-801522-13-smb Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: machine: x86_64 Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: clock source: unix Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: pcre jit disabled Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: detected number of CPU cores: 4 Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: current working directory: / Oct 14 02:48:02.857982 dv-cinder-801522-13-smb devstack@keystone.service[81500]: detected binary path: /usr/bin/uwsgi-core Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: your processes number limit is 47680 Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: your memory page size is 4096 bytes Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: detected max file descriptor number: 2048 Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: lock engine: pthread robust mutexes Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: thunder lock: enabled Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 14 02:48:02.858543 dv-cinder-801522-13-smb devstack@keystone.service[81500]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 02:48:02.899198 dv-cinder-801522-13-smb devstack@keystone.service[81500]: Python main interpreter initialized at 0x557dd5ace9c0 Oct 14 02:48:02.899198 dv-cinder-801522-13-smb devstack@keystone.service[81500]: python threads support enabled Oct 14 02:48:02.899198 dv-cinder-801522-13-smb devstack@keystone.service[81500]: your server socket listen backlog is limited to 100 connections Oct 14 02:48:02.899198 dv-cinder-801522-13-smb devstack@keystone.service[81500]: your mercy for graceful operations on workers is 90 seconds Oct 14 02:48:02.899528 dv-cinder-801522-13-smb devstack@keystone.service[81500]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 02:48:02.899629 dv-cinder-801522-13-smb devstack@keystone.service[81500]: *** Operational MODE: preforking *** Oct 14 02:48:02.899967 dv-cinder-801522-13-smb devstack@keystone.service[81500]: *** uWSGI is running in multiple interpreter mode *** Oct 14 02:48:02.899967 dv-cinder-801522-13-smb devstack@keystone.service[81500]: spawned uWSGI master process (pid: 81500) Oct 14 02:48:02.900109 dv-cinder-801522-13-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 14 02:48:02.900728 dv-cinder-801522-13-smb devstack@keystone.service[81500]: spawned uWSGI worker 1 (pid: 81512, cores: 1) Oct 14 02:48:02.906216 dv-cinder-801522-13-smb devstack@keystone.service[81500]: spawned uWSGI worker 2 (pid: 81513, cores: 1) Oct 14 02:48:02.906216 dv-cinder-801522-13-smb devstack@keystone.service[81500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 02:48:07.983816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:48:07.983816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: from cryptography.utils import int_from_bytes Oct 14 02:48:07.984578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:48:07.984578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: from cryptography.utils import int_from_bytes Oct 14 02:48:07.984578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:48:07.984578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: from cryptography.utils import int_from_bytes Oct 14 02:48:07.985084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 02:48:07.985084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: from cryptography.utils import int_from_bytes Oct 14 02:48:08.034762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 02:48:08.034936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 02:48:08.035023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 02:48:08.035114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 02:48:08.035193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] command line args: [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 02:48:08.035265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] command line args: [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 02:48:08.035387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 02:48:08.035478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 02:48:08.035558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ================================================================================ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 02:48:08.035636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ================================================================================ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 02:48:08.035803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] admin_token = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.035888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] admin_token = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config_dir = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config_dir = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] config_source = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] config_source = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] debug = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] debug = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.036826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.037979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_config_append = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_config_append = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_dir = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_dir = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.038988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.039924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.040979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.041967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.042128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.042212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.042612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.042739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.042822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] publish_errors = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.042901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] publish_errors = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.043943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] standard_threads = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] standard_threads = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.044942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_journal = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_journal = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_json = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_json = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_stderr = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_stderr = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] use_syslog = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] use_syslog = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 02:48:08.045880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.045963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.046945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.047907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048440 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048592 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.048916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049324 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.049883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.050876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051132 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.051892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.052844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.053963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.054924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055392 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.055932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.056814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.057388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.057583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.057704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.057813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.057955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.058960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.059902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.060961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.061899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.062882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.063989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.064966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.065925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.066941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.067925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.068903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.069986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.070944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.071938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.072042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.072169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.external = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.072249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.external = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.072435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.password = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.password = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.073965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] auth.token = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] auth.token = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.074995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.075961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.076966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.077942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.078876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.079947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.080931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.081912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.082878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.083841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.084845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.085945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.086934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.087980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.088968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.089941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.090910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091375 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091752 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.091987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.092909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.093880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.094858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095008 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.095972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.096980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.097994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.098968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.099946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.100910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.101896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.102989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.103967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.104972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.105956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106269 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.106988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.107969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.108973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.109951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.110998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.111999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.112845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.113948 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.114923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.115963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.116961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.117943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.118943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.119090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.119176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.119838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.119932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.120971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.121920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.122859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123734 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.123976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 02:48:08.124864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 02:48:08.124940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 02:48:08.155107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.155263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.155346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.165653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.165744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.165823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.173916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.174016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.202212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.202447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.202760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.202993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.256345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.256498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.305139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.305373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.305516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.305753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.459867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.460990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.461088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.461262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.484328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.484589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.484697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.484843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.484933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.485918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.496851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.497201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.509475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.509632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.509719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.509840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.510417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.510591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.510674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.510812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.510894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.511029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.511120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.511245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.511326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.511455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 14 02:48:08.528620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.528832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 02:48:08.529177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.529258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.529382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 02:48:08.529464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 02:48:08.529662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.529752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.529929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.530032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 14 02:48:08.530194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.530275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.530456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.530536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.530720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.530982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.540050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.540331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.540618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.540705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.540902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.540985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.541198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.541541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.547925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.548598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.550879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.551169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.551456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.551549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.551740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.551821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.552961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.553963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.554235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.576934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.577520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.578405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.578693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.578991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.579279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.583394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.583684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.583966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.584048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.584251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.584566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.590890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.591178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.591530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.591822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.596853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.597154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.597444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.597527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.597732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.597813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.598924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.599105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.599375 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.614396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.614679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.622084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.622084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.622309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.622391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.622465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.622465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.622684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.622684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.626386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.626844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.629674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.629984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.632924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.633264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.633359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.633559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.633654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.633860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.633942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.634128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.634211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.634423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.634514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.634702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.651782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.651942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.652077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.652186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.652347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.652481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.652635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.652756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.659544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.659654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.661115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.661214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.662656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.662750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.662936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.663021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.665711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.665810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.666005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.666088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.666318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.666475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.666605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.666690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.666997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.667080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.678187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.678317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.678483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.678582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.678767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.678861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.679997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.680080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.695448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.695547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.698931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.699028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.701858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.701945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.703306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.703402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.704801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.704905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.705087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.705173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.705480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.705573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.711845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.711936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.713898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.713988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.716838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.716983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.717238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.717322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.717524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.717622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.717803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.717886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.725622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.725719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.725923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.726011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.726219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.726303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.733194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.733298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 14 02:48:08.733479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.733564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.733762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.733847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.734965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.735990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.736943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 14 02:48:08.772211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557dd5ace9c0 pid: 81513 (default app) Oct 14 02:48:08.772317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557dd5ace9c0 pid: 81512 (default app) Oct 14 02:48:08.775471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b887b-1d9b-4ed8-9d79-eb05567b154c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:08.775788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b887b-1d9b-4ed8-9d79-eb05567b154c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:08.776064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b887b-1d9b-4ed8-9d79-eb05567b154c None None] PATH_INFO: `/v3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:08.780205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Fri Oct 14 02:48:08 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:16.529954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:16.530472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:16.530557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:16.534766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:16.540140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:16.540648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:16.540747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:16.611153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: INFO dbcounter [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] Registered counter for database keystone Oct 14 02:48:16.629701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG oslo_db.sqlalchemy.engines [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:48:16.636234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writer thread running {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:48:16.810836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG passlib.handlers.bcrypt [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81513) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 02:48:16.811137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG passlib.handlers.bcrypt [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81513) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 02:48:16.869271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:16.870891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:16.996552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 02:48:17.472011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:17.540764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: INFO dbcounter [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] Registered counter for database keystone Oct 14 02:48:17.561550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG oslo_db.sqlalchemy.engines [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 02:48:17.567864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writer thread running {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 02:48:17.685457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263bccc-db34-46d0-802c-834de3c4b178 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:17.689678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:17.690295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:17.690574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:17.690847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:17.699460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:17.750738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 02:48:17.751030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd97f-616c-4b71-8448-1957c902af1a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:17.760881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Fri Oct 14 02:48:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 02:48:17.766772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:17.783574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839f1eb-c4ca-4710-a93a-c9ab4d465617 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:17.787961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:17.789087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:17.789376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:17.789652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] PATH_INFO: `/v3/projects/1ee22ef683e5495db6f46559187e0847` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:17.791243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] RBAC: Authorizing `identity:get_project(project_id=1ee22ef683e5495db6f46559187e0847)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:17.843746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING keystone.common.rbac_enforcer.enforcer [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 14 02:48:17.844097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bd527-7c9d-4e20-b175-38bfe58c1e41 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:17.848588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Oct 14 02:48:17 2022] GET /identity/v3/projects/1ee22ef683e5495db6f46559187e0847 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:19.949486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecf383-0787-4653-9d2a-6ef9146d59e7 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:19.949971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecf383-0787-4653-9d2a-6ef9146d59e7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:19.949971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecf383-0787-4653-9d2a-6ef9146d59e7 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:19.954030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:19.959341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:19.959765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:19.959900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:19.980590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:19.982090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:19.989806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 02:48:20.254668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecf383-0787-4653-9d2a-6ef9146d59e7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:20.266547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecf383-0787-4653-9d2a-6ef9146d59e7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:20.270980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded3342-0ac6-42d7-b37f-61fc9e9111df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:20.271576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded3342-0ac6-42d7-b37f-61fc9e9111df admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:20.271861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded3342-0ac6-42d7-b37f-61fc9e9111df admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:20.272137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded3342-0ac6-42d7-b37f-61fc9e9111df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:20.280152 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded3342-0ac6-42d7-b37f-61fc9e9111df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:20.281970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded3342-0ac6-42d7-b37f-61fc9e9111df admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:20.290518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Fri Oct 14 02:48:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 02:48:20.296103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:20.305008 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18765a4f-d76c-429e-9158-3cb7d1b468c3 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:20.309316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc822cab-c7b5-4359-bc49-e36de3051401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:20.309967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc822cab-c7b5-4359-bc49-e36de3051401 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:20.310252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc822cab-c7b5-4359-bc49-e36de3051401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:20.310529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc822cab-c7b5-4359-bc49-e36de3051401 admin admin] PATH_INFO: `/v3/users/139ae328324b4c2c91733b77c70a8a8b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:20.311825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc822cab-c7b5-4359-bc49-e36de3051401 admin admin] RBAC: Authorizing `identity:get_user(user_id=139ae328324b4c2c91733b77c70a8a8b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:20.313676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc822cab-c7b5-4359-bc49-e36de3051401 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:20.315184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Fri Oct 14 02:48:20 2022] GET /identity/v3/users/139ae328324b4c2c91733b77c70a8a8b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:22.496622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02786-9156-4fd4-8cb6-8dc5fdddb06e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:22.497190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02786-9156-4fd4-8cb6-8dc5fdddb06e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:22.497190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02786-9156-4fd4-8cb6-8dc5fdddb06e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:22.498508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:22.503687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:22.504095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:22.504267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:22.522217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:22.523409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:22.529867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e77be-2e39-419b-b293-a429b714e373 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:22.530154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e77be-2e39-419b-b293-a429b714e373 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:22.530429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e77be-2e39-419b-b293-a429b714e373 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:22.531740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:22.537008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:22.537293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:22.537569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:22.579010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG passlib.handlers.bcrypt [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81512) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 14 02:48:22.579404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG passlib.handlers.bcrypt [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81512) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 14 02:48:22.606482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:22.629314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:22.630877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:22.728525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:22.869443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:22.899309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:22.980401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535de7b4-ae32-4933-b861-137817d8a299 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:22.999302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.014550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.015186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.015468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.015743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.026795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:23.035571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:23.036676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:23.037733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:23.044598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.101119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682349d-cd33-4d59-9b96-d26eaf497e94 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.103684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:23.131492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:23.136776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.137648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.137935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.138212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.139209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.140718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.144910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c46ea-9ab0-4032-a5f6-500ddbc2ba05 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.170065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.sql.core [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 02:48:23.170065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 02:48:23.170065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [parameters: {'id': '311ab2d6e03642ee9358a7eed9f4d5fc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 02:48:23.170065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 02:48:23.179667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.180633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.180922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.181198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.182454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:23.182762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.184165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:48:23.190133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 02:48:23.190929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application yield resource Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise self.value Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application session.commit() Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 02:48:23.191856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.flush() Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application compat.raise_( Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 02:48:23.192740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 02:48:23.193612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:48:23.194371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [parameters: {'id': '311ab2d6e03642ee9358a7eed9f4d5fc', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 02:48:23.195148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:23.195898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.196716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 8/15] 10.222.0.13 () {60 vars in 1137 bytes} [Fri Oct 14 02:48:22 2022] POST /identity/v3/domains => generated 190 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:23.198144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.200323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:23.205761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.298280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ff4d1-bd66-4d2a-a98d-513a15d29597 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.304817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7cbfd-e6ad-4f85-8088-4d45bd51840c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.332460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.333308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.333593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.333866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.338037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.338665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.338943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.339217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] PATH_INFO: `/v3/users/139ae328324b4c2c91733b77c70a8a8b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.340349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] RBAC: Authorizing `identity:get_user(user_id=139ae328324b4c2c91733b77c70a8a8b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.342207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.343771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:23 2022] GET /identity/v3/users/139ae328324b4c2c91733b77c70a8a8b => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:23.349276 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.351401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.352906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.364021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:48:23.369564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:23.370411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:48:23.371262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:48:23.371262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:48:23.371262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:23.371262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:23.376259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.398020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:23.448949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424d64-7d9b-41bb-9c56-0dc3f5624d45 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.477159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47191e9-61c3-4c45-8c0c-a1c7ded9843c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.482280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.482916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.483201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.483480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.484663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.486113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.487680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:23.493268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:23.517344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.518207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.518489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.518760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.519401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:23.519701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.521107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accaf55-f96a-4100-a493-678303998ffa None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.538464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:23.576743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:23.597305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eca92a-3bbe-40c9-b197-342702346323 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:23.634701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45526716-e6b9-49fd-9433-28d193673fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:23.635381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526716-e6b9-49fd-9433-28d193673fde None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:23.635665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526716-e6b9-49fd-9433-28d193673fde None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:23.635945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526716-e6b9-49fd-9433-28d193673fde None admin] PATH_INFO: `/v3/domains/default/users/139ae328324b4c2c91733b77c70a8a8b/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:23.637958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45526716-e6b9-49fd-9433-28d193673fde None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=139ae328324b4c2c91733b77c70a8a8b, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:23.639437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45526716-e6b9-49fd-9433-28d193673fde None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:23.807389 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Fri Oct 14 02:48:23 2022] PUT /identity/v3/domains/default/users/139ae328324b4c2c91733b77c70a8a8b/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:48:26.213215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375e9f-e2d8-4d5d-8427-28f42af85526 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.213758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375e9f-e2d8-4d5d-8427-28f42af85526 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.213758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375e9f-e2d8-4d5d-8427-28f42af85526 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.215148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:26.220922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e24f-6c39-40c4-a877-2fd48a0f1a4c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.221712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e24f-6c39-40c4-a877-2fd48a0f1a4c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.222206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e24f-6c39-40c4-a877-2fd48a0f1a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.249510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1624e24f-6c39-40c4-a877-2fd48a0f1a4c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:26.251345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1624e24f-6c39-40c4-a877-2fd48a0f1a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:26.328421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:26.575240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8235-6228-4678-8220-3e70b781fff9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.575922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8235-6228-4678-8220-3e70b781fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.576444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8235-6228-4678-8220-3e70b781fff9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.578020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:26.583472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.583992 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.584508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.613064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:26.614593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:26.664193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a53261-78a3-45e4-9439-0d97c518f104 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.664857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a53261-78a3-45e4-9439-0d97c518f104 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.665353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a53261-78a3-45e4-9439-0d97c518f104 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.667514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 13/25] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:26.678842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe058570-1801-4455-a49f-5c479bb8fc7f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.679366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe058570-1801-4455-a49f-5c479bb8fc7f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.679909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe058570-1801-4455-a49f-5c479bb8fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.713238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:26.714199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fe058570-1801-4455-a49f-5c479bb8fc7f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:26.715595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fe058570-1801-4455-a49f-5c479bb8fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:26.720988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 13/26] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:26.765629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:26.808313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 14/27] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:26.809596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a4a19-2964-450b-8b22-0f227ab2f526 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.809886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a4a19-2964-450b-8b22-0f227ab2f526 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.810164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a4a19-2964-450b-8b22-0f227ab2f526 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.812949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:26.825980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:26.826205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:26.826481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:26.863327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:26.868777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:26.875525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:26.987905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4d4a4-c256-4fd8-9d3d-d1e1ce63324c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:27.009714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 16/29] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:27.047975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:27.048988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.049477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.049982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.066607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:27.068609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:48:27.090272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:27.091148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:48:27.091950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:48:27.091950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:48:27.091950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:27.093720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 14/30] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:27.099674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:27.133245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:27.197303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:27.220503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8f4b0-7050-4a95-bc3b-f57c9b2f0ae7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:27.264415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:27.264415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.264415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.264415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.264812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:27.264812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:27.265307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:27.271513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486017-7ef1-4ec0-9220-7a3c992ca09c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:27.279151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:27.286914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 17/31] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:27.287579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:27.332163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:27.333177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.333664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.334166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.335063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:27.336685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:27.423256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1bd78-11c7-46f1-9198-af6ef58697ac None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:27.454717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 15/32] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Oct 14 02:48:27 2022] POST /identity/v3/roles => generated 225 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:27.457482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:27.461044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:27.461936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.462447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.463450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.464353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:27.466089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:27.593368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32180770-4030-4189-a1e5-cf2e28d52da3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:27.616832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:27.646888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9334-7e31-483e-895a-6acae237f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:27.647534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9334-7e31-483e-895a-6acae237f137 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.647885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9334-7e31-483e-895a-6acae237f137 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.648168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9334-7e31-483e-895a-6acae237f137 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.648874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9334-7e31-483e-895a-6acae237f137 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:27.650488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9334-7e31-483e-895a-6acae237f137 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:27.739617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 18/33] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Oct 14 02:48:27 2022] POST /identity/v3/roles => generated 219 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:27.740769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:27.766804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 16/34] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:48:27 2022] POST /identity/v3/projects => generated 301 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:27.771296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6d35-babc-45b0-a78e-a16ff2868320 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.771588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6d35-babc-45b0-a78e-a16ff2868320 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.771879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d6d35-babc-45b0-a78e-a16ff2868320 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.774734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 17/35] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:27.777636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d39ca-ac94-4f60-a486-a0c5d2f8a1df None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.777924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d39ca-ac94-4f60-a486-a0c5d2f8a1df None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.778205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d39ca-ac94-4f60-a486-a0c5d2f8a1df None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.781066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:27.782742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.783032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.783322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.816297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:27.817651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:27.828613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:27.886640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edfcc9-29c4-42d3-a4af-d45bbaf91913 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:27.931011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babf2f5-34fb-400d-924e-94b4ec3c2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:27.932177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babf2f5-34fb-400d-924e-94b4ec3c2ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.932494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babf2f5-34fb-400d-924e-94b4ec3c2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.932784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babf2f5-34fb-400d-924e-94b4ec3c2ae8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.948017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babf2f5-34fb-400d-924e-94b4ec3c2ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4babf2f5-34fb-400d-924e-94b4ec3c2ae8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:27.954364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:27.955322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:27.956081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 19/37] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:48:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:27.957323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:27.957631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:27.957890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:27.979398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:27.981024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:28.038558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 19/38] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:28.039420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.062657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:28.137750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:28.144236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf58b1-c0a2-413a-a998-73bf0e3ec8df None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.177908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.178520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.178805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.179083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.179754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:28.180064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.182205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.190531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 20/40] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:28.195986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.248741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:28.298753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473919-d344-4f9f-a44e-4b6a3fff46b3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.313412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.336024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.337129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.337927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.338349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] PATH_INFO: `/v3/users/139ae328324b4c2c91733b77c70a8a8b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.339726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] RBAC: Authorizing `identity:get_user(user_id=139ae328324b4c2c91733b77c70a8a8b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.341355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.343101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 21/41] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:28 2022] GET /identity/v3/users/139ae328324b4c2c91733b77c70a8a8b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:28.348223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.414043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c269488-68a6-426d-847c-16f160c39eac None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.445843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd8a06-c2b1-40b8-a854-7b983e93eb71 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.447130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.447740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.448024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.448303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.449015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.450393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.463300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:28.479534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.480165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.480476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.480756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.481923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.483418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.485001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 22/42] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:28.485760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.520433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 21/43] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Oct 14 02:48:28 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:48:28.520433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.541796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:28.600886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea328d94-917c-415b-a1cf-2e7aedd29ee6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.635801 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bf791-cb4d-409c-9095-060e5cac9d51 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.644004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.644692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.644979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.645257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.646496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.647973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.650473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 23/44] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:28.655923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:28.685752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.686550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.687173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.687589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.688502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.domain.id=default, user.id=139ae328324b4c2c91733b77c70a8a8b) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:28.688982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.690459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10853207-be21-4fec-afef-23d8162a4139 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.699385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 22/45] 10.222.0.13 () {56 vars in 1322 bytes} [Fri Oct 14 02:48:28 2022] GET /identity/v3/role_assignments?user.id=139ae328324b4c2c91733b77c70a8a8b&scope.domain.id=default&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 530 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:28.722509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:28.773991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8939ae-a8f6-4bd1-85e4-82e5934e4f09 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:28.810641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa06a9-c61c-4958-8593-148c99fdbdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:28.811271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa06a9-c61c-4958-8593-148c99fdbdda None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:28.811556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa06a9-c61c-4958-8593-148c99fdbdda None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:28.811834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa06a9-c61c-4958-8593-148c99fdbdda None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:28.812544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa06a9-c61c-4958-8593-148c99fdbdda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:28.814007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa06a9-c61c-4958-8593-148c99fdbdda None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:28.903495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:48:28 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:48:31.049302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590b23-109f-417b-8891-e8de5a22c78e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:31.049812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590b23-109f-417b-8891-e8de5a22c78e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:31.049812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590b23-109f-417b-8891-e8de5a22c78e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:31.051142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:31.057188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:31.057579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:31.057742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:31.075155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:31.076337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:31.139875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:31.411034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590b23-109f-417b-8891-e8de5a22c78e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:31.491952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:31.510461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590b23-109f-417b-8891-e8de5a22c78e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:31.544031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c2739-79bc-49cf-9da0-dc652507aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:31.544691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2739-79bc-49cf-9da0-dc652507aa61 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:31.544973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2739-79bc-49cf-9da0-dc652507aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:31.545244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2739-79bc-49cf-9da0-dc652507aa61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:31.546363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2739-79bc-49cf-9da0-dc652507aa61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:31.547789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c2739-79bc-49cf-9da0-dc652507aa61 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:31.549377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 24/49] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:31.554989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:31.587960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:31.648926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8674eb-d78a-4a4d-a8e4-b44c64e90f4d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:31.682619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f613d1-7b1a-4b73-bf27-98c608490aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:31.683230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f613d1-7b1a-4b73-bf27-98c608490aa5 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:31.683515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f613d1-7b1a-4b73-bf27-98c608490aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:31.683799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f613d1-7b1a-4b73-bf27-98c608490aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:31.684478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f613d1-7b1a-4b73-bf27-98c608490aa5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:31.685935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f613d1-7b1a-4b73-bf27-98c608490aa5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:31.746692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1140 bytes} [Fri Oct 14 02:48:31 2022] POST /identity/v3/projects => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:33.878602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7114-e837-47eb-ae23-228c5140ee56 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:33.879109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7114-e837-47eb-ae23-228c5140ee56 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:33.879213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7114-e837-47eb-ae23-228c5140ee56 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:33.880579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 25/51] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:33.885917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:33.886309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:33.886484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:33.904901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:33.906075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:33.970084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 27/52] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:34.237732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7114-e837-47eb-ae23-228c5140ee56 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:34.334529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7114-e837-47eb-ae23-228c5140ee56 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:34.367365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff95df-24bd-4381-8ac5-7ce98cffc03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:34.367982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff95df-24bd-4381-8ac5-7ce98cffc03b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:34.368291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff95df-24bd-4381-8ac5-7ce98cffc03b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:34.368602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff95df-24bd-4381-8ac5-7ce98cffc03b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:34.369707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff95df-24bd-4381-8ac5-7ce98cffc03b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:34.371135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff95df-24bd-4381-8ac5-7ce98cffc03b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:34.372704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:34.378135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:34.396082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:34.473812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc9fb8-faf3-43f7-a2a0-564c054c5667 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:34.506610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15481f2b-86da-4931-a3bc-5c3b4ef01c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:34.507149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481f2b-86da-4931-a3bc-5c3b4ef01c36 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:34.507427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481f2b-86da-4931-a3bc-5c3b4ef01c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:34.507696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481f2b-86da-4931-a3bc-5c3b4ef01c36 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:34.508327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15481f2b-86da-4931-a3bc-5c3b4ef01c36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:34.509796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15481f2b-86da-4931-a3bc-5c3b4ef01c36 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:34.718132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 28/54] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:48:34 2022] POST /identity/v3/users => generated 275 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:37.765842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41d617-0f5e-44b1-9745-9942a378e92e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:37.767131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41d617-0f5e-44b1-9745-9942a378e92e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:37.767617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41d617-0f5e-44b1-9745-9942a378e92e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:37.769349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 27/55] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:37.775569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f370-60b0-4894-bf4f-b83656d3c5a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:37.776578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f370-60b0-4894-bf4f-b83656d3c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:37.777071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f370-60b0-4894-bf4f-b83656d3c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:37.797371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4544f370-60b0-4894-bf4f-b83656d3c5a6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:37.798953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4544f370-60b0-4894-bf4f-b83656d3c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:37.874680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 29/56] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:37.905682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f94c1a-68cd-411b-bd9f-67104a9f9211 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:37.905969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f94c1a-68cd-411b-bd9f-67104a9f9211 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:37.906518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f94c1a-68cd-411b-bd9f-67104a9f9211 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:37.908068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 28/57] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:37.913553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ac91-d879-4c9d-8b50-837d6556b276 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:37.913849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ac91-d879-4c9d-8b50-837d6556b276 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:37.914136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89ac91-d879-4c9d-8b50-837d6556b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:37.924372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:37.937825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-dc89ac91-d879-4c9d-8b50-837d6556b276 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:37.945343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc89ac91-d879-4c9d-8b50-837d6556b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:38.023047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 30/58] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:38.168500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10239d32-5ab5-4851-be87-1e6ecab34dd8 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.168808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10239d32-5ab5-4851-be87-1e6ecab34dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.169066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10239d32-5ab5-4851-be87-1e6ecab34dd8 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.170426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 29/59] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:38.178495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.178730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.179019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.199744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:38.201099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:38.292878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:38.298846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10239d32-5ab5-4851-be87-1e6ecab34dd8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.318134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:38.334601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.423330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10239d32-5ab5-4851-be87-1e6ecab34dd8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:38.468836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:38.490868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:38.491516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.491799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.492069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.514776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:38.519914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:38.520777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:38.521518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:38.528476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:38.529334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.532236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70cfb3-ab16-4757-b62d-a97880644571 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:38.593388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:38.594037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.594323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.594602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.616232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:38.622158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:38.623006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:38.623756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 32/62] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:38.624423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.661300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:38.699875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cd16d-215a-48c7-b1ae-52f9b8c657c7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:38.740097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:38.741609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.742142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.742597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.743804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8aee-a0fe-43f1-8558-c9647b338b81 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:38.744290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:38.744821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:38.746765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:38.757115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 31/63] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:38.759003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.771325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:38.782340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:38.783001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.783269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.783533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.795804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:38.800665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:38.801509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 33/64] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:38.803102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.872762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8073f-b7d5-41ee-ab87-4f299865aa6b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:38.903095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c1c9-0258-4a24-8b1f-a7af82c0d1d0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:38.905584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:38.906190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.906474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.906748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.907405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:38.907710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:38.909128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed696c7-48ff-47b4-8f18-8e47c4b5f2d7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:38.913980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:38.917662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 32/65] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:38.918800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeab10-e945-469b-97df-093f17d7e956 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.919085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeab10-e945-469b-97df-093f17d7e956 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.919360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeab10-e945-469b-97df-093f17d7e956 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.920575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 33/66] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:38.924180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeab10-e945-469b-97df-093f17d7e956 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:38.945097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2194968b-748c-4423-8ae1-fde2925421e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:38.945733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194968b-748c-4423-8ae1-fde2925421e5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.946556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194968b-748c-4423-8ae1-fde2925421e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.946836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2194968b-748c-4423-8ae1-fde2925421e5 None admin] PATH_INFO: `/v3/users/139ae328324b4c2c91733b77c70a8a8b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.947988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194968b-748c-4423-8ae1-fde2925421e5 None admin] RBAC: Authorizing `identity:get_user(user_id=139ae328324b4c2c91733b77c70a8a8b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:38.949502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2194968b-748c-4423-8ae1-fde2925421e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:38.951079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 34/67] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/users/139ae328324b4c2c91733b77c70a8a8b => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:38.952187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e30f-1120-4494-876d-7494bd993bfa None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:38.952498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e30f-1120-4494-876d-7494bd993bfa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:38.952825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e30f-1120-4494-876d-7494bd993bfa None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:38.953973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 35/68] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:38.954679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e30f-1120-4494-876d-7494bd993bfa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.007384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.028625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeab10-e945-469b-97df-093f17d7e956 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.055075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e30f-1120-4494-876d-7494bd993bfa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.061678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.062310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.062580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.062854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.063522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:39.063829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.065251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35577a35-5caa-476b-9816-11f3efc6a74c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.073814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.074926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02def3-2613-4697-9eb1-b940ae27401e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.075223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02def3-2613-4697-9eb1-b940ae27401e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.075504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02def3-2613-4697-9eb1-b940ae27401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.091826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.092508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.092798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.092951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-eb02def3-2613-4697-9eb1-b940ae27401e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:39.093057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] PATH_INFO: `/v3/users/1d3b79a78dd94570afe565420033ed70` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.094153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-eb02def3-2613-4697-9eb1-b940ae27401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:39.108308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3b79a78dd94570afe565420033ed70)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.109774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.115857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 36/70] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:38 2022] GET /identity/v3/users/1d3b79a78dd94570afe565420033ed70 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.115857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.149963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.160289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 35/71] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:39.162157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.162455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.162739 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.181974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:39.183184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:39.217532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8da6be-b5c7-41e7-b4e9-3c883fe295e1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.230935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.249830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 36/72] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:39.250512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.267361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.268548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.269382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.269883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.271208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.273688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.276825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.278077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.355656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a1b31-8503-4683-a1ef-256be94eb51d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.379168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.390888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.391532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.392141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.399027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] PATH_INFO: `/v3/users/1d3b79a78dd94570afe565420033ed70` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.399027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] RBAC: Authorizing `identity:get_user(user_id=1d3b79a78dd94570afe565420033ed70)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.399027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.399027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 37/74] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/users/1d3b79a78dd94570afe565420033ed70 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.401252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.413557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca822-a85c-4f6d-acb7-646f78e4545e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.458899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.459535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.460049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.460152 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.462100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.463760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.469967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.469967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.515463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773dc5d-a9a1-4075-b71a-7da2a728ae3b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.518775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.550511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.551167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.551448 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.551729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/139ae328324b4c2c91733b77c70a8a8b/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.553648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da7b921e04a475db00a4d75aebb7c8f, user_id=139ae328324b4c2c91733b77c70a8a8b, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.555121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.573276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d096a8f-f6a9-448b-a2d0-8f65d80df116 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.606070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.606703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.606988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.607267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.608404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.609851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.611474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.612235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.636802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:39 2022] PUT /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/139ae328324b4c2c91733b77c70a8a8b/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:39.637608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.708705 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.728233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c300e54-74f0-45db-93d8-d7d193878836 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.743911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:39.765177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f31d01-aef7-41a4-840b-2c1c2560ddd1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.767520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.768194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.768525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.768865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.781818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:39.787499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:39.788986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:39.790538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.809632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.810314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.810600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.810899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/1d3b79a78dd94570afe565420033ed70/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.812944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da7b921e04a475db00a4d75aebb7c8f, user_id=1d3b79a78dd94570afe565420033ed70, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.814555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.895947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dd299-145b-437f-9954-c3b35b6f7f37 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:39.906746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:39 2022] PUT /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/1d3b79a78dd94570afe565420033ed70/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:39.907564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:39.953911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:39.954819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:39.955250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:39.956652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:39.958633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:39.961181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:39.964103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 41/80] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:39.970347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:40.025929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:40.030385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b9ca-55aa-484c-bd6f-7a7d3f13cde2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:40.042175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:40.069593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:40.070390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:40.071220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:40.071497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/1d3b79a78dd94570afe565420033ed70/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:40.074071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] RBAC: Authorizing `identity:create_grant(project_id=4da7b921e04a475db00a4d75aebb7c8f, user_id=1d3b79a78dd94570afe565420033ed70, role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:40.075696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:40.102336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064e31f-beda-464a-bc5d-b0d950d92cf3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:40.137069 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:40.137998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:40.138454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:40.138901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:40.139740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:40.140243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:40.142169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:40.155233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 42/81] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:40.156285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:40.167937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 40/82] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:39 2022] PUT /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/1d3b79a78dd94570afe565420033ed70/roles/6758e63c58de49968859f2dd43ea8a24 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:40.169346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:40.304952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bbd8e-6080-431b-a828-e8cf2917b5fd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:40.349177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:40.349177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:40.349177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:40.349177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] PATH_INFO: `/v3/users/1d3b79a78dd94570afe565420033ed70` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:40.350625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3b79a78dd94570afe565420033ed70)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:40.352364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:40.353960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f06d-2ecd-4126-b4dd-565c9a83b29c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:40.357307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:40 2022] GET /identity/v3/users/1d3b79a78dd94570afe565420033ed70 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:40.359728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:40.362668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:40.401780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:40.402403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:40.402690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:40.402969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:40.403630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:40.405759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:40.423071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:40.488594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f02f-a5fa-4e4c-b215-36ff6b29b298 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:40.491273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 43/84] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:48:40 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:40.539144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0265-ce48-4705-bbb1-5a8eff03f62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:40.539875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0265-ce48-4705-bbb1-5a8eff03f62c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:40.540162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0265-ce48-4705-bbb1-5a8eff03f62c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:40.540455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0265-ce48-4705-bbb1-5a8eff03f62c None admin] PATH_INFO: `/v3/projects/9cca500a03a44e909d5c902c751ca99e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:40.541662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0265-ce48-4705-bbb1-5a8eff03f62c None admin] RBAC: Authorizing `identity:get_project(project_id=9cca500a03a44e909d5c902c751ca99e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:40.543194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0265-ce48-4705-bbb1-5a8eff03f62c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:40.545162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:40 2022] GET /identity/v3/projects/9cca500a03a44e909d5c902c751ca99e => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:40.550825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:40.673401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e492f2-18f1-4d41-a33c-93f7f68dcf9f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:40.712892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85eb76-d97d-4e1b-b9d7-ca2f8b35da6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:40.713648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85eb76-d97d-4e1b-b9d7-ca2f8b35da6a None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:40.713999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85eb76-d97d-4e1b-b9d7-ca2f8b35da6a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:40.714342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85eb76-d97d-4e1b-b9d7-ca2f8b35da6a None admin] PATH_INFO: `/v3/projects/9cca500a03a44e909d5c902c751ca99e/users/1d3b79a78dd94570afe565420033ed70/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:40.716360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85eb76-d97d-4e1b-b9d7-ca2f8b35da6a None admin] RBAC: Authorizing `identity:create_grant(project_id=9cca500a03a44e909d5c902c751ca99e, user_id=1d3b79a78dd94570afe565420033ed70, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:40.717925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85eb76-d97d-4e1b-b9d7-ca2f8b35da6a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:40.792690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:40 2022] PUT /identity/v3/projects/9cca500a03a44e909d5c902c751ca99e/users/1d3b79a78dd94570afe565420033ed70/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:42.811103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482035-14a8-4379-bd99-a1c6b801cb24 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:42.811638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482035-14a8-4379-bd99-a1c6b801cb24 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:42.811924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482035-14a8-4379-bd99-a1c6b801cb24 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:42.813586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 43/87] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:42.818724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2029-04c7-4630-9cc1-675158175719 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:42.819120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2029-04c7-4630-9cc1-675158175719 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:42.819451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c2029-04c7-4630-9cc1-675158175719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:42.843439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-713c2029-04c7-4630-9cc1-675158175719 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:42.844701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-713c2029-04c7-4630-9cc1-675158175719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:42.860130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:42.874310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a64ec-d94b-4e29-a49a-20346813346b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:42.874596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a64ec-d94b-4e29-a49a-20346813346b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:42.874865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a64ec-d94b-4e29-a49a-20346813346b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:42.876494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 44/88] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:42.881566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:42.881848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:42.882123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:42.911245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:42.912544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:42.941468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 45/89] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:42.946517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52325dcf-b0f6-4772-b1dd-6fb4e25ababb None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:42.946820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52325dcf-b0f6-4772-b1dd-6fb4e25ababb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:42.947110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52325dcf-b0f6-4772-b1dd-6fb4e25ababb None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:42.957842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 46/90] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:42.965307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:42.965602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:42.965883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.001657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:43.002867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:43.054514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 45/91] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 14 02:48:43.152627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 47/92] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:48:43.473315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:43.514768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:43.558057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:43.626964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a58e-91da-4d81-b065-f13b7ebddb0e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:43.680949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f5e80-c1ed-441b-bc34-ff4cb487dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:43.682410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f5e80-c1ed-441b-bc34-ff4cb487dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.683063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f5e80-c1ed-441b-bc34-ff4cb487dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.685686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f5e80-c1ed-441b-bc34-ff4cb487dbb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.705694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f5e80-c1ed-441b-bc34-ff4cb487dbb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-536f5e80-c1ed-441b-bc34-ff4cb487dbb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:43.710840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:43.712321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:43.713099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:43.713679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:43.715469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 46/93] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:48:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:43.721522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c079-118e-4dff-a4ef-ce7ee7caedb2 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.722024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c079-118e-4dff-a4ef-ce7ee7caedb2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.722471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c079-118e-4dff-a4ef-ce7ee7caedb2 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.724144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 47/94] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:43.725081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c079-118e-4dff-a4ef-ce7ee7caedb2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:43.733927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c92c77-725c-4ad6-92e4-013796e35901 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:43.773315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:43.774508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.775221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.775504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.787037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:43.791958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:43.792852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:43.793627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 48/95] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:48:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:43.797545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:43.833286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:43.841661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c079-118e-4dff-a4ef-ce7ee7caedb2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:43.879154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cebb5-8c99-4cb0-8a27-1eee9260c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:43.880151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cebb5-8c99-4cb0-8a27-1eee9260c864 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.880474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cebb5-8c99-4cb0-8a27-1eee9260c864 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.880760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cebb5-8c99-4cb0-8a27-1eee9260c864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.892642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cebb5-8c99-4cb0-8a27-1eee9260c864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a40cebb5-8c99-4cb0-8a27-1eee9260c864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:43.897440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:43.898336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:43.899668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 48/96] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:43.905073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.905370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.905654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.906716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270dff9-a899-404c-9bf0-8daba8da0d19 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:43.923444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:43.924698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:43.941109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:43.941721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.942003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.942276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.943105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:43.943412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:43.945121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3f89-b20f-4113-a0f7-787de0c674af None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:43.954497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 49/97] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:43.955677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7da48-fb78-4e7f-9aa8-c5d842497b02 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:43.955967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7da48-fb78-4e7f-9aa8-c5d842497b02 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:43.956242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7da48-fb78-4e7f-9aa8-c5d842497b02 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:43.960540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 50/98] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:43.960540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7da48-fb78-4e7f-9aa8-c5d842497b02 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:43.964067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.012434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 49/99] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:44.012434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.077143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7da48-fb78-4e7f-9aa8-c5d842497b02 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.120965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.121716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.122070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.122418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.123279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:44.123659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.125359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.128018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.136662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 51/100] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:48:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:44.137332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.149760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8319b5a-533b-4d6c-9edc-216eb35cf940 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.185672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.186507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.186892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.187309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.188138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:44.188586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.190079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9cd54-d798-45dc-88d2-3bc89fcf8834 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.199250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 50/101] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:44.205202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.205612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.205999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.206600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.225899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:44.227071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:44.247164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be705e-f59b-4ad2-a56a-9bc86c83274a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.284792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.285355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.285643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.285923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] PATH_INFO: `/v3/users/139ae328324b4c2c91733b77c70a8a8b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.287560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] RBAC: Authorizing `identity:get_user(user_id=139ae328324b4c2c91733b77c70a8a8b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.289248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.290831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 52/102] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/users/139ae328324b4c2c91733b77c70a8a8b => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:44.291608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.302465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 51/103] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:44.303721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.385628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.399670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15fbe1-4cef-422f-b659-e154a6967e6e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.406833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ad90b-5853-410e-bd51-2ac5b8278f16 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.431674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.436623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e7b7c-db8f-4dea-b8f6-45b52760761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.437269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7b7c-db8f-4dea-b8f6-45b52760761e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.437561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7b7c-db8f-4dea-b8f6-45b52760761e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.437842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e7b7c-db8f-4dea-b8f6-45b52760761e None admin] PATH_INFO: `/v3/users/1d3b79a78dd94570afe565420033ed70` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.438973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e7b7c-db8f-4dea-b8f6-45b52760761e None admin] RBAC: Authorizing `identity:get_user(user_id=1d3b79a78dd94570afe565420033ed70)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.440577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e7b7c-db8f-4dea-b8f6-45b52760761e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.442098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 53/104] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/users/1d3b79a78dd94570afe565420033ed70 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:44.444722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12116ab-ed3c-4ed1-9791-25afbd5be57a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.444722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12116ab-ed3c-4ed1-9791-25afbd5be57a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.444722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12116ab-ed3c-4ed1-9791-25afbd5be57a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.445046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 54/105] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:44.448588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12116ab-ed3c-4ed1-9791-25afbd5be57a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.450321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.451107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.451395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.451671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] PATH_INFO: `/v3/users/1d3b79a78dd94570afe565420033ed70` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.453218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3b79a78dd94570afe565420033ed70)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.454677 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.456267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 52/106] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/users/1d3b79a78dd94570afe565420033ed70 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:44.461532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.555389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12116ab-ed3c-4ed1-9791-25afbd5be57a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.574001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacfc27-d29c-44fb-9f42-0b8237a378d8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.588119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.588770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.589054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.589328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.599236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:44.604928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:44.605766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:44.606522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 55/107] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:44.607149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.608953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1f5f-b10b-4403-8455-888cb9b704bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.609568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1f5f-b10b-4403-8455-888cb9b704bb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.609855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1f5f-b10b-4403-8455-888cb9b704bb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.610134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1f5f-b10b-4403-8455-888cb9b704bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.625708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.666984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.677876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1f5f-b10b-4403-8455-888cb9b704bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.679385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1f5f-b10b-4403-8455-888cb9b704bb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.707512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637619df-eb25-422f-ae3f-97205a9d68bc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:44.741091 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:44.741725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.742014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.742341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.775927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 53/108] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:44.777419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:44.777712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:44.777993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:44.795380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:44.796586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:44.808767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:44.810194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:44.837141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.862171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 54/109] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:44.863159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.873447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:44.917861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 56/110] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:44.923070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:44.983765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c21e-514a-45e6-85a4-d63498ae50f4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.018806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.019413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.019702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.019972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.027185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ae42-79b6-4ef6-b895-bbf67ce0ca7b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.062191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.062749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.063036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.063317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.067102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.073991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:45.078895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:45.090611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 57/111] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:45.091563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.096491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.097873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.110160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.187344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3914aa-f0fb-4225-8309-4bc489670eb8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.199430 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:45.199430 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.224282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.224913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.225192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.225474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.226133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:45.226435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.227842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.235600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 58/113] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.235600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.276030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.298147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daa12a-53ff-442f-9abb-76380375ef90 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.323384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.332124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.332776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.333055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.333328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.336885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.336885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.338191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 56/114] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.339742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.341222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1182620-7f28-420c-a0d9-0f3177eb4f38 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.374575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.375208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.375497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.375778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.376936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.378410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.380037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 59/115] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.380037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.437021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60fee4-e02c-495a-be36-0e6d177a8586 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.470856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.471458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.471741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.472017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.472709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:45.473018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.474387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.482241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 57/116] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.483092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.486990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675f412-3fb1-46c7-87ac-ef77e6b0fc54 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.491938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.521146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.521770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.522055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.522332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.523463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.524943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.526496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 60/117] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.527260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.547428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.582208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3ae4-464a-435e-9075-a7f389c4d7c2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.614201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.614825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.615103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.615377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.616512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.618472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.620092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 58/118] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.620872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.625433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610223c-55fb-41e5-977c-5003151242e8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.660172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.660832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.661117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.661393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] PATH_INFO: `/v3/users/1d3b79a78dd94570afe565420033ed70` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.662547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] RBAC: Authorizing `identity:get_user(user_id=1d3b79a78dd94570afe565420033ed70)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.664000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.665610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 61/119] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/users/1d3b79a78dd94570afe565420033ed70 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.666443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.696965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.720945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e79aa1-6e97-4e94-bcbe-13b02bafb4f9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.752663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.753947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.754551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.754837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.755118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.755854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=4da7b921e04a475db00a4d75aebb7c8f, user.id=139ae328324b4c2c91733b77c70a8a8b) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:45.756171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.757660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.764850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 59/120] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/role_assignments?user.id=139ae328324b4c2c91733b77c70a8a8b&scope.project.id=4da7b921e04a475db00a4d75aebb7c8f&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.765650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.767523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b7dd0-685d-4074-b783-f8a843807a6b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.804292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.805484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.805764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.806035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.806790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] RBAC: Adding query filter params (role.id=6758e63c58de49968859f2dd43ea8a24, scope.project.id=4da7b921e04a475db00a4d75aebb7c8f, user.id=1d3b79a78dd94570afe565420033ed70) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:45.807098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.808611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.818300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 62/121] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/role_assignments?user.id=1d3b79a78dd94570afe565420033ed70&scope.project.id=4da7b921e04a475db00a4d75aebb7c8f&role.id=6758e63c58de49968859f2dd43ea8a24 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.821989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:45.903634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34f8e-a229-46b8-89fc-b3449f3265d0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.961260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:45.964612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:45.964612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:45.964612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] PATH_INFO: `/v3/users/7298536ac432474a97a7e4574bf0bd02` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:45.974650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5d16-5d8e-456a-9650-5f0fb7b8f243 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:45.975177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:45.982950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] RBAC: Authorizing `identity:get_user(user_id=7298536ac432474a97a7e4574bf0bd02)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:45.984834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:45.986734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 60/122] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/users/7298536ac432474a97a7e4574bf0bd02 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:45.987717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:46.025925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.025925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.026237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.026513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.027183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.029334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.099721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f21d03-8079-4570-8dfc-e5d06a5cb855 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:46.118803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 63/123] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:48:45 2022] POST /identity/v3/projects => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:46.119807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:46.122464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:46.148657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.149284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.149567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.149844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.150591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] RBAC: Adding query filter params (role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, scope.project.id=4da7b921e04a475db00a4d75aebb7c8f, user.id=1d3b79a78dd94570afe565420033ed70) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:46.150906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.152468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.158934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 61/124] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:45 2022] GET /identity/v3/role_assignments?user.id=1d3b79a78dd94570afe565420033ed70&scope.project.id=4da7b921e04a475db00a4d75aebb7c8f&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:46.159883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:46.246518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:46.249092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31152b64-6e30-4c0e-a3de-b1419770934c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:46.300623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.301434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.301813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.302228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.312728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6d3b9-80b3-4289-baf3-e2df30b105e3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:46.366327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.367697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.368137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.368595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.370230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.372311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.374294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 62/125] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:46 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:46.381238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:46.388933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.390432 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.394000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:46.511567 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 64/126] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:46.511733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf48f5-1e9e-48ab-aeb8-e3e77772914a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:46.514042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:46.539856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:46.548178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.548956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.549240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.549522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/7298536ac432474a97a7e4574bf0bd02/roles/57e51448d348447ca4273f4e2a3f996d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.555003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da7b921e04a475db00a4d75aebb7c8f, user_id=7298536ac432474a97a7e4574bf0bd02, role_id=57e51448d348447ca4273f4e2a3f996d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.555003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.613597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e890b0-ddd7-4827-9ad1-f8a4e21a55fe None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:46.615106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:46.626309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 63/127] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:46 2022] PUT /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/users/7298536ac432474a97a7e4574bf0bd02/roles/57e51448d348447ca4273f4e2a3f996d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:46.652608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67875fd2-7e56-41a9-8395-64bf206c8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.652608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875fd2-7e56-41a9-8395-64bf206c8a19 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.652608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875fd2-7e56-41a9-8395-64bf206c8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.652608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67875fd2-7e56-41a9-8395-64bf206c8a19 None admin] PATH_INFO: `/v3/projects/9cca500a03a44e909d5c902c751ca99e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.654642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67875fd2-7e56-41a9-8395-64bf206c8a19 None admin] RBAC: Authorizing `identity:get_project(project_id=9cca500a03a44e909d5c902c751ca99e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.655529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67875fd2-7e56-41a9-8395-64bf206c8a19 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.662581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 65/128] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:46 2022] GET /identity/v3/projects/9cca500a03a44e909d5c902c751ca99e => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:46.664858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:46.781837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5a79-d4d0-49be-8efa-e94a785d0c66 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:46.819927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:46.821111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:46.821397 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:46.821674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:46.822402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] RBAC: Adding query filter params (role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, scope.project.id=9cca500a03a44e909d5c902c751ca99e, user.id=1d3b79a78dd94570afe565420033ed70) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:46.822713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:46.824238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47352f-fc40-46e6-ad8d-5646e6c1522d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:46.830474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 64/129] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:46 2022] GET /identity/v3/role_assignments?user.id=1d3b79a78dd94570afe565420033ed70&scope.project.id=9cca500a03a44e909d5c902c751ca99e&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:48.339872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70ab78-788a-4420-a577-4904dd6584ec None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:48.340419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70ab78-788a-4420-a577-4904dd6584ec None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:48.340908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70ab78-788a-4420-a577-4904dd6584ec None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:48.342272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 66/130] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:48.347586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d336ace-66ec-41ce-9e40-ace32931eaf3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:48.347998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d336ace-66ec-41ce-9e40-ace32931eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:48.348256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d336ace-66ec-41ce-9e40-ace32931eaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:48.365977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1d336ace-66ec-41ce-9e40-ace32931eaf3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:48.367163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1d336ace-66ec-41ce-9e40-ace32931eaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:48.414501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:48.433552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 65/131] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:48.701329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70ab78-788a-4420-a577-4904dd6584ec None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:48.761768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22bfb-7557-46e2-9a89-c486d2ddf878 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:48.762061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22bfb-7557-46e2-9a89-c486d2ddf878 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:48.762340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed22bfb-7557-46e2-9a89-c486d2ddf878 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:48.763834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 66/132] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:48.768846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:48.769137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:48.769417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:48.787038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:48.788219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:48.800741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70ab78-788a-4420-a577-4904dd6584ec None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:48.835454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:48.836079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:48.836364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:48.836669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:48.837762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:48.839218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:48.840814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 67/133] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:48.846309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:48.856944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 67/134] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:48:48.884663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:48.942532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44895f8c-48b2-4350-a791-6a412f5a4aab None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:48.974466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:48.975062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:48.975346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:48.975620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:48.976826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:48.978430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:49.081657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 68/135] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:48:48 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:48:49.122004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:49.227057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fd60c-11ab-451c-b0e7-1fb32bf90067 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:49.241044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:49.262687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:49.263326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:49.263610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:49.263885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:49.275905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:49.281202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:49.282213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:49.283630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 68/136] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:49.288242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:49.439694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:49.446616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b6ae6-b93e-4a74-940f-4fbd5a564c22 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:49.483092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:49.483667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:49.483957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:49.484237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:49.484980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:49.485294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:49.486729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:49.497714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 69/137] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:49.503252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:49.608583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b6797-dabe-4e9a-bb52-8a8a631b840d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:49.644095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:49.645094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:49.645597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:49.646124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] PATH_INFO: `/v3/users/7298536ac432474a97a7e4574bf0bd02` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:49.647507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] RBAC: Authorizing `identity:get_user(user_id=7298536ac432474a97a7e4574bf0bd02)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:49.649853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:49.652092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 69/138] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:49 2022] GET /identity/v3/users/7298536ac432474a97a7e4574bf0bd02 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:49.657698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:49.767385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0e4e4-3f28-45d9-a6b3-66412813deb1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:49.802908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:49.803529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:49.803816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:49.804099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:49.830834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:49.874922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:49.876501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:49.980020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 70/139] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:49.985569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:50.029603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:50.092151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf4da-70c9-4312-b0ef-b78678d33605 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:50.126848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe697d-a8c6-4a02-b65f-5c7ace12085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:50.127496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe697d-a8c6-4a02-b65f-5c7ace12085b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:50.127785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe697d-a8c6-4a02-b65f-5c7ace12085b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:50.128066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe697d-a8c6-4a02-b65f-5c7ace12085b None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:50.129241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe697d-a8c6-4a02-b65f-5c7ace12085b None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:50.130704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe697d-a8c6-4a02-b65f-5c7ace12085b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:50.133504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 70/140] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:49 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:50.139320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:50.197222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:50.243622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c0cf6-8711-4dd3-a4fe-8a98a51e2906 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:50.279702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:50.280240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:50.280570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:50.280850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:50.281577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] RBAC: Adding query filter params (role.id=57e51448d348447ca4273f4e2a3f996d, scope.project.id=4da7b921e04a475db00a4d75aebb7c8f, user.id=7298536ac432474a97a7e4574bf0bd02) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:50.281891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:50.283355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa336e-4275-42dd-bc22-2f8bd17ef5ee None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:50.289199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 71/141] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:50 2022] GET /identity/v3/role_assignments?user.id=7298536ac432474a97a7e4574bf0bd02&scope.project.id=4da7b921e04a475db00a4d75aebb7c8f&role.id=57e51448d348447ca4273f4e2a3f996d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:51.345771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9661-9bfb-4b30-a52a-42e24bedc0f5 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.423735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9661-9bfb-4b30-a52a-42e24bedc0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.423735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9661-9bfb-4b30-a52a-42e24bedc0f5 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.423735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 71/142] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:51.424006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f6c5-e20a-4401-bfe1-878f29593893 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.424006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f6c5-e20a-4401-bfe1-878f29593893 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.424006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30f6c5-e20a-4401-bfe1-878f29593893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.424006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3d30f6c5-e20a-4401-bfe1-878f29593893 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:51.424006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3d30f6c5-e20a-4401-bfe1-878f29593893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:51.452424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 72/143] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:51.483881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e051473-dc43-458d-b5fd-7e6eaa7b8ec9 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.484248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e051473-dc43-458d-b5fd-7e6eaa7b8ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.484475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e051473-dc43-458d-b5fd-7e6eaa7b8ec9 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.485955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 72/144] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:51.490786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b530b-9c77-42bc-adca-2598d9f6bfd8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.491077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b530b-9c77-42bc-adca-2598d9f6bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.491349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b530b-9c77-42bc-adca-2598d9f6bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.510276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-584b530b-9c77-42bc-adca-2598d9f6bfd8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:51.511482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-584b530b-9c77-42bc-adca-2598d9f6bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:51.562998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:51.583045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 73/145] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:51.637112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b07a9-935c-483f-8c31-3a3be222a522 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.637382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b07a9-935c-483f-8c31-3a3be222a522 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.637614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b07a9-935c-483f-8c31-3a3be222a522 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.639095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 73/146] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:51.644455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.644754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.645034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.664409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:51.665610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:51.720697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b07a9-935c-483f-8c31-3a3be222a522 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:51.736014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 74/147] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:51.822058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b07a9-935c-483f-8c31-3a3be222a522 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:51.831095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:51.845698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:51.856993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:51.857628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.857970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.858262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.869681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:51.874541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:51.875645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:51.877095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 74/148] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:48:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:51.881288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:51.950303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09739-8b8f-438f-8cf1-f7b3e85df7a6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:51.960712 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:51.981720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d35121-0580-4152-9b25-af873cb5f899 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:51.984378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:51.985030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:51.985310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:51.985580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:51.996984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:52.001780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:52.003283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:52.004377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 75/149] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:48:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:52.005264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.019277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.019874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.020155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.020450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.021115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:52.021420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.022798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.030721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 75/150] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:52.035293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.061194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:52.108401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e85de-dbae-44f0-90f6-9d563626a0d4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.128951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45fd0c-6b51-41d8-8b0c-c738bcfac5ac None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.143269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.144049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.144333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.144640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.145763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.147213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.148846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 76/151] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:52.153348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.162143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.162746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.163028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.163299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.164513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:52.164821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.166199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.173944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 76/152] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:48:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:52.174773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.197850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:52.257234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2de6-a5ca-4f58-bd8e-bc0d06f9f086 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.264851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:52.274052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52e700-daad-4b5f-8de2-45648d6f8def None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.294270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.294903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.295182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.295460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] PATH_INFO: `/v3/users/44a0ee96e49b4872a669580c575b658c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.308221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.308375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] RBAC: Authorizing `identity:get_user(user_id=44a0ee96e49b4872a669580c575b658c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.308906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.309186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.309460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.309791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.310111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.311565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 77/153] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:52 2022] GET /identity/v3/users/44a0ee96e49b4872a669580c575b658c => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:52.311674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.312173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.396171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 77/154] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:48:52 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:52.397039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.408609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:52.416408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd1f0-16fd-435d-b88c-7701715a4e06 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.459424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.460824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.461280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.461624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] PATH_INFO: `/v3/users/44a0ee96e49b4872a669580c575b658c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.462865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] RBAC: Authorizing `identity:get_user(user_id=44a0ee96e49b4872a669580c575b658c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.464334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.466172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 78/155] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:52 2022] GET /identity/v3/users/44a0ee96e49b4872a669580c575b658c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:52.471962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.514592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a2abc-3a50-430c-b767-ba0510b44196 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.555060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.556222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.556618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.556899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.558464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.560337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.562092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 78/156] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:52 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:52.569211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.588407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a96d2-69b7-4b3b-9491-b664b867b293 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.590235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:52.633783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.634425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.634704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.634977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.636135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.638533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.639452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 79/157] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:52 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:52.645443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:52.691340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:52.693956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c543-d959-4d0a-99a6-7a12a58d689e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.737841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a316b-b66b-46ab-849e-0298933a8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.737841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a316b-b66b-46ab-849e-0298933a8639 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.738298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a316b-b66b-46ab-849e-0298933a8639 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.738490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a316b-b66b-46ab-849e-0298933a8639 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/44a0ee96e49b4872a669580c575b658c/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.741863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a316b-b66b-46ab-849e-0298933a8639 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f, user_id=44a0ee96e49b4872a669580c575b658c, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.743328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a316b-b66b-46ab-849e-0298933a8639 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.774439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c47fb7-eb30-4160-91e2-62ea71e450ef None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:52.810315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 79/158] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:52 2022] PUT /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/44a0ee96e49b4872a669580c575b658c/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:48:52.816165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15fb48-6598-4e13-b19c-f3ad3b46448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:52.817572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15fb48-6598-4e13-b19c-f3ad3b46448a None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:52.817572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15fb48-6598-4e13-b19c-f3ad3b46448a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:52.817572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15fb48-6598-4e13-b19c-f3ad3b46448a None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/44a0ee96e49b4872a669580c575b658c/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:52.820215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15fb48-6598-4e13-b19c-f3ad3b46448a None admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f, user_id=44a0ee96e49b4872a669580c575b658c, role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:52.821724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15fb48-6598-4e13-b19c-f3ad3b46448a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:52.906589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 80/159] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:52 2022] PUT /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/44a0ee96e49b4872a669580c575b658c/roles/6758e63c58de49968859f2dd43ea8a24 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:54.690684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66fbf-5650-4582-b6a7-86572786d0ca None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:54.691599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66fbf-5650-4582-b6a7-86572786d0ca None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:54.692074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e66fbf-5650-4582-b6a7-86572786d0ca None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:54.693925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 80/160] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:54.699333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f2b51-56f3-400c-ac3a-7507706eecd9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:54.700148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f2b51-56f3-400c-ac3a-7507706eecd9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:54.700659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f2b51-56f3-400c-ac3a-7507706eecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:54.719994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-016f2b51-56f3-400c-ac3a-7507706eecd9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:54.721519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-016f2b51-56f3-400c-ac3a-7507706eecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:54.757359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541390e-50d3-4546-91ad-68ad274a9032 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:54.757663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541390e-50d3-4546-91ad-68ad274a9032 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:54.757921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541390e-50d3-4546-91ad-68ad274a9032 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:54.759288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 81/161] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:54.764186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b766-b11e-4ee1-95e4-7a4b068f31e1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:54.764503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b766-b11e-4ee1-95e4-7a4b068f31e1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:54.764785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5b766-b11e-4ee1-95e4-7a4b068f31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:54.783900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6cf5b766-b11e-4ee1-95e4-7a4b068f31e1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:54.785049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6cf5b766-b11e-4ee1-95e4-7a4b068f31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:54.797856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 81/162] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:54.854446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 82/163] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:48:55.011983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb7f4-b506-42cc-9c39-6a9f06b76b75 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.012163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb7f4-b506-42cc-9c39-6a9f06b76b75 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.012470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bb7f4-b506-42cc-9c39-6a9f06b76b75 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.014001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 82/164] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:55.019995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebda88-6dab-4365-b569-4a07d205741f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.020328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebda88-6dab-4365-b569-4a07d205741f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.020591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebda88-6dab-4365-b569-4a07d205741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.035040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.041953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e9ebda88-6dab-4365-b569-4a07d205741f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:55.043151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e9ebda88-6dab-4365-b569-4a07d205741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:55.091325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb7f4-b506-42cc-9c39-6a9f06b76b75 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.119091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 83/165] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:55.124959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.136167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71587aea-de68-4fa2-ab6a-b87d88193780 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.136477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71587aea-de68-4fa2-ab6a-b87d88193780 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.136751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71587aea-de68-4fa2-ab6a-b87d88193780 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.138283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 84/166] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:48:55.138854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71587aea-de68-4fa2-ab6a-b87d88193780 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.211438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bb7f4-b506-42cc-9c39-6a9f06b76b75 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.241235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71587aea-de68-4fa2-ab6a-b87d88193780 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.251711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654164d-2988-4efc-8e9a-d1e5c3e7517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.252331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654164d-2988-4efc-8e9a-d1e5c3e7517c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.252637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654164d-2988-4efc-8e9a-d1e5c3e7517c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.253052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654164d-2988-4efc-8e9a-d1e5c3e7517c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.263779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654164d-2988-4efc-8e9a-d1e5c3e7517c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8654164d-2988-4efc-8e9a-d1e5c3e7517c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:55.268764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:55.269783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:55.271169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 83/167] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:48:55.275634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.275920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.276195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.281183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.281822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.282105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.282381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.283656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:55.285719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:55.287350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 85/168] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:55.288069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.295663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.296660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:55.297880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:55.374227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 84/169] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:55.381799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.401177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.408855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad0249-a22b-4fd8-9603-b417cad79bec None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.445110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.445745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.446038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.446314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.446980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:55.447290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:55.448707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:55.457011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 86/170] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:55.457806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.499344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f34bcb-9451-42f4-b159-5df59a146f27 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.532181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.535361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.535978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.536266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.536572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.537232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:55.543121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:55.567950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a685-9092-40cd-9039-8aa3cdf02df9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.601871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.602496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.602780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.603067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.613182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 85/171] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:48:55 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:48:55.613918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.624728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:55.636420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:55.637581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 87/172] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:55.638570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.705582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.742721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351a6f7-a082-474c-8fe4-1ab0d0295474 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.772190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3b574-2050-441f-a2a0-1ff67afdb1d4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.780408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.781359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.781359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.781654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] PATH_INFO: `/v3/users/ec1903b144654785af38b659c2c959f8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.798420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] RBAC: Authorizing `identity:get_user(user_id=ec1903b144654785af38b659c2c959f8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:55.799825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:55.801565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 86/173] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/users/ec1903b144654785af38b659c2c959f8 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:55.802338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.806905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.817512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.818129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.818415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.818684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:55.819779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:55.819779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:55.821112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:55.833921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 88/174] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:55.834740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:55.938061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fa651-e04f-4bfc-bec5-ff9ec545f013 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.961849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c1bab-cadd-4416-b959-5e41c4a264db None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:55.973794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:55.985409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:55.986362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:55.986362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:55.986620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.000306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:56.004693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:56.004995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:56.006040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:48:56.006903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:56.007514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.007514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.007514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.007514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.008555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.010152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 89/175] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:56.010917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.012746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 87/176] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:48:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:56.015641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.091223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:56.131516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895f2a1-5149-4016-9caa-f6ffc4086038 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:56.151655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7229d-9d40-4c8c-b5d5-ec1a3e3cabe0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:56.170484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.171103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.171389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.171663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.172485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:56.173142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.174620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.188453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 88/177] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:56.189545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.191627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.192347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.192721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.193060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] PATH_INFO: `/v3/users/44a0ee96e49b4872a669580c575b658c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.194316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] RBAC: Authorizing `identity:get_user(user_id=44a0ee96e49b4872a669580c575b658c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.195809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.197439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 90/178] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/users/44a0ee96e49b4872a669580c575b658c => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:56.198275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.284834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:56.310210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eab2f-de9a-4717-a7da-f583ddffeb47 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:56.322169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddd5dc-c886-4099-a6ae-3ebf8301c26a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:56.350033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:56.360045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.360778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.361065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.361344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/ec1903b144654785af38b659c2c959f8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.363495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f, user_id=ec1903b144654785af38b659c2c959f8, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.365355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.366458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.367312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.368036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.369044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] PATH_INFO: `/v3/users/44a0ee96e49b4872a669580c575b658c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.370633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] RBAC: Authorizing `identity:get_user(user_id=44a0ee96e49b4872a669580c575b658c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.372152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.376537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 91/179] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/users/44a0ee96e49b4872a669580c575b658c => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:56.376537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.438954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 89/180] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:56 2022] PUT /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/ec1903b144654785af38b659c2c959f8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:48:56.440412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.530949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d849318-5121-432f-b093-b05c352736f7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:56.582469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600595f4-a158-4b16-b6e0-2265452b8c0e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:56.595902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:56.612332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.612903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.613183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.613453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.637274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:56.637274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:56.637534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:56.637754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:56.705229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:56.724523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.726399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.777515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:56.779010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:56.844342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 92/181] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:56.849909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.947469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 90/182] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:48:56.953727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:56.963572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:57.017417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:57.038292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd695d2-08e3-45d3-a1fe-ddf9b072856d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:57.092772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff54d-b6ca-4702-89bf-05bd90bd94ec None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:57.103844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:57.104508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:57.104797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:57.105126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:57.106291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:57.107759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:57.116102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 93/183] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:57.118790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:57.170490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:57.171241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:57.171529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:57.171804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:57.173216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:57.174678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:57.176631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 91/184] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:56 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:57.187085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:57.301959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02501e-c42c-4972-b001-7a71ddc9bc90 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:57.324699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:57.354123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4490dd7-d49f-4bdb-a88f-8044ca93a59a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:57.357097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:57.357730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:57.358018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:57.358296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:57.359044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f, user.id=44a0ee96e49b4872a669580c575b658c) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:57.359359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:57.360843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27d6c-ba9a-440c-9ba8-8dba0ea78e74 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:57.367682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 94/185] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:57 2022] GET /identity/v3/role_assignments?user.id=44a0ee96e49b4872a669580c575b658c&scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:57.392931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:57.393554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:57.393938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:57.394220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:57.394970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] RBAC: Adding query filter params (role.id=6758e63c58de49968859f2dd43ea8a24, scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f, user.id=44a0ee96e49b4872a669580c575b658c) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:57.395283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:57.396790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d998f3-d022-4067-932b-a88720b59e9a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:57.404131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 92/186] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:48:57 2022] GET /identity/v3/role_assignments?user.id=44a0ee96e49b4872a669580c575b658c&scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f&role.id=6758e63c58de49968859f2dd43ea8a24 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:58.129235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5569c-4e7e-4e7f-b0f3-49edc3eda7f9 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.129752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5569c-4e7e-4e7f-b0f3-49edc3eda7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.129860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5569c-4e7e-4e7f-b0f3-49edc3eda7f9 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.131175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 95/187] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:58.136304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.136705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.136887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.155339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:58.158837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:58.176509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d677-f7e4-4c13-aa63-0943e615104f None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.176800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d677-f7e4-4c13-aa63-0943e615104f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.177078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d677-f7e4-4c13-aa63-0943e615104f None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.178449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 96/188] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:58.184060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.184349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.184656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.202354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:58.203542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:58.221557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:58.231586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 93/189] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:58.273684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 97/190] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:48:58.498352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:58.545215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:58.570126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:58.601967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9a949-0560-4c51-a05f-be921bb56b9c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:58.638915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:58.639546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.639825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.640097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.646881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ecafd-0e66-46d9-b170-7f17d4c1f86f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:58.656817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:58.662050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:58.662973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:58.663754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 94/191] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:58.671352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:58.686197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:58.686833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.687114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.687392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.688519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:58.689970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:58.691707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 98/192] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:58.697545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:58.725452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:58.779887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691150d-43cc-47e9-8e3a-eac10f873f8b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:58.805775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccfa4d-64e2-4bae-9449-a1bddf95b17e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:58.810066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:58.817016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:58.820838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.820838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.820838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.820838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:58.820838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:58.821287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c6112-5b36-4369-b3f7-7831c6411fb1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:58.829491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 95/193] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:58.830675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1aac-9520-4973-a513-f6aba9e454bc None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.830957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1aac-9520-4973-a513-f6aba9e454bc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.831229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f1aac-9520-4973-a513-f6aba9e454bc None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.832444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 96/194] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:48:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:48:58.835465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1aac-9520-4973-a513-f6aba9e454bc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:58.846059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dffa2-2507-44d8-8853-db2c9f302927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:58.846662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dffa2-2507-44d8-8853-db2c9f302927 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.846943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dffa2-2507-44d8-8853-db2c9f302927 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.847207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dffa2-2507-44d8-8853-db2c9f302927 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.847850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dffa2-2507-44d8-8853-db2c9f302927 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:58.849310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dffa2-2507-44d8-8853-db2c9f302927 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:58.934305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f1aac-9520-4973-a513-f6aba9e454bc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:58.950518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 99/195] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:48:58 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:48:58.951563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.951854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.952134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.973288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:48:58.974531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:48:58.978767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:58.979548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:58.979836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:58.986733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] PATH_INFO: `/v3/users/7f04db083ef549179aa2f33c5c973013` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:58.998291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f04db083ef549179aa2f33c5c973013)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:59.000300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:59.002476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 97/196] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:58 2022] GET /identity/v3/users/7f04db083ef549179aa2f33c5c973013 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:59.009096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:59.055041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 100/197] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:48:59.065675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:59.118771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e450f9-0820-4c02-a736-eb82012ddbd2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:59.156972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:59.160424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:59.160424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:59.160424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:59.160424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:59.175477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:59.175477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 98/198] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:48:59 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:48:59.175655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:59.179525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:59.272692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e70a2-110e-4912-adee-9510054707ed None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:59.309384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:59.309982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:59.310267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:59.310543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/7f04db083ef549179aa2f33c5c973013/roles/57e51448d348447ca4273f4e2a3f996d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:59.312517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f, user_id=7f04db083ef549179aa2f33c5c973013, role_id=57e51448d348447ca4273f4e2a3f996d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:59.313945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:59.323746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:59.384788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 101/199] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:48:59 2022] PUT /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/users/7f04db083ef549179aa2f33c5c973013/roles/57e51448d348447ca4273f4e2a3f996d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:48:59.456726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2194-3f07-4f33-a35e-625c492371e7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:59.478544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:59.496948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:59.497699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:59.497985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:59.498256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:59.510983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:48:59.516616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:48:59.517598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:48:59.518410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 99/200] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:48:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:48:59.524175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:59.605896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:59.639633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720586e-7109-46b6-9694-40441a345fdd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:59.683657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:59.684514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:59.684941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:59.691254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:59.691254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:48:59.691254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:59.691254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:59.697377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 102/201] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:48:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:59.703720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:59.809009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83322620-5523-4b50-989f-5362bf310a22 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:59.845499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:59.846147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:59.846430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:59.846706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] PATH_INFO: `/v3/users/ec1903b144654785af38b659c2c959f8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:48:59.847853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] RBAC: Authorizing `identity:get_user(user_id=ec1903b144654785af38b659c2c959f8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:48:59.849465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:48:59.851464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:48:59 2022] GET /identity/v3/users/ec1903b144654785af38b659c2c959f8 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:48:59.856907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:48:59.961597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81290c-2c45-4a77-8a85-15551fd4f7b6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:48:59.990746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:48:59.997370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:48:59.998077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:48:59.998360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:48:59.998637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:00.071129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:00.072763 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:00.181561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:48:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:00.189524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:00.237990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:00.292984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621047-0f86-4a46-b3ed-ff4dfbd6d712 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:00.328227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a966-a3ff-4b10-bb85-95a9ac76adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:00.329220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a966-a3ff-4b10-bb85-95a9ac76adf7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:00.329693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a966-a3ff-4b10-bb85-95a9ac76adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:00.330160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a966-a3ff-4b10-bb85-95a9ac76adf7 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:00.331536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a966-a3ff-4b10-bb85-95a9ac76adf7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:00.333288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a966-a3ff-4b10-bb85-95a9ac76adf7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:00.335807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 101/204] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:00 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:00.342406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:00.374530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:00.451510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae9854-7075-4298-83d2-41c44a86ba5f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:00.486417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:00.487032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:00.487315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:00.487591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:00.488323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] RBAC: Adding query filter params (role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f, user.id=ec1903b144654785af38b659c2c959f8) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:00.488664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:00.490108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c7c88-933d-451e-968c-d5171a94ed01 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:00.495896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 104/205] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:00 2022] GET /identity/v3/role_assignments?user.id=ec1903b144654785af38b659c2c959f8&scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:01.300319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a0d7f-36f8-4cc8-a952-2ea7bb78a6b1 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.300886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a0d7f-36f8-4cc8-a952-2ea7bb78a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.301158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a0d7f-36f8-4cc8-a952-2ea7bb78a6b1 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.302430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 102/206] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:01.308316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0ece-087f-4e92-a447-149411b4a49e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.308786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0ece-087f-4e92-a447-149411b4a49e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.308955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0ece-087f-4e92-a447-149411b4a49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.328795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9d7d0ece-087f-4e92-a447-149411b4a49e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:01.330007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9d7d0ece-087f-4e92-a447-149411b4a49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:01.405052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 105/207] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:01.439759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7c12-d57f-44e4-a7fa-626b959d5bc3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.440045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7c12-d57f-44e4-a7fa-626b959d5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.440302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c7c12-d57f-44e4-a7fa-626b959d5bc3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.441791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 103/208] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:01.447288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9425-bdaf-4bea-8b32-8560c4a486d1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.447577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9425-bdaf-4bea-8b32-8560c4a486d1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.447852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a9425-bdaf-4bea-8b32-8560c4a486d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.465444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-399a9425-bdaf-4bea-8b32-8560c4a486d1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:01.466599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-399a9425-bdaf-4bea-8b32-8560c4a486d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:01.483639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:01.533417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 106/209] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:01.658545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc390f-cb50-4825-92ef-0b92157f59bf None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.658867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc390f-cb50-4825-92ef-0b92157f59bf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.659097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc390f-cb50-4825-92ef-0b92157f59bf None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.660592 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 104/210] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:01.666425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.666721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.667002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.675490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc390f-cb50-4825-92ef-0b92157f59bf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:01.688433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:01.689640 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:01.758935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 107/211] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:01.781136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc390f-cb50-4825-92ef-0b92157f59bf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:01.795357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:01.800085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:01.818131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:01.818761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.819063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.819322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.830005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:01.834906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:01.835768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:01.836596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 105/212] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:01.841671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:01.891026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:01.908063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21008b-7707-4187-b43f-a3f8e32ff39a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:01.943321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:01.943898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.944181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.944483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.945572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:01.946659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02f31e-4ca9-4407-9e5c-4a20c42b3122 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:01.947017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:01.948825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 108/213] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:01.953846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:01.984294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:01.985170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:01.985447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:01.986122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:01.987052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:01.987355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:01.988847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.001816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 106/214] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:02.002796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:02.040144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:02.063888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea6e7d-f89f-42a0-bee4-e66711765e98 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.097787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.098387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.098667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.098941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.099589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:02.101724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.105391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51edde3-603b-4cf6-b088-295d0d1098c0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.138684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.139306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.139586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.139859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] PATH_INFO: `/v3/users/bb3a69546d494914bfb64dcb892f9397` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.153230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] RBAC: Authorizing `identity:get_user(user_id=bb3a69546d494914bfb64dcb892f9397)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:02.154686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.156272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 107/215] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:02 2022] GET /identity/v3/users/bb3a69546d494914bfb64dcb892f9397 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:02.157087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:02.218790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 109/216] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:01 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:49:02.218790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:02.230766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:02.256486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:02.265417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650f210-5ba0-466b-bf6f-f9e064d4fa2d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.308686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.310100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.310423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.310883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.324094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:02.329958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:02.330905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:02.331840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:02.332509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b1e4-2124-4420-a09b-8a04afed900f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.332921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 108/217] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:02.338003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:02.387363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.388687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.388974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.389256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.390999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] RBAC: Adding query filter params (role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, user.id=bb3a69546d494914bfb64dcb892f9397, scope.system=all) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:02.390999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:02.392726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.398520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 110/218] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Oct 14 02:49:02 2022] GET /identity/v3/role_assignments?user.id=bb3a69546d494914bfb64dcb892f9397&scope.system=all&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:02.460197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90742eb-08b3-47c8-b5c0-5e4c89400ac5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.512515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.513465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.513738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.514012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.514732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:02.515039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:02.516871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.534304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 109/219] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:02.541570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:02.625806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:02.666045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab220e-3421-43f6-9651-4ee00b4ed44c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.710671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.711306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.711588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.711860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] PATH_INFO: `/v3/users/7f04db083ef549179aa2f33c5c973013` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.713020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=7f04db083ef549179aa2f33c5c973013)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:02.714477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.717818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 111/220] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:02 2022] GET /identity/v3/users/7f04db083ef549179aa2f33c5c973013 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:02.724398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:02.750601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:02.833312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba08bc-5e45-4faa-9edb-4797cf04e90d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:02.871122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:02.871122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:02.871122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:02.871465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:02.943318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:02.944869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:02.963808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:03.050664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 110/221] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:03.056936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:03.166646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28142da-6906-41f9-9097-6a62de020dc8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:03.203542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856f59-f50d-4295-9b4b-70e53ec9a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:03.204180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856f59-f50d-4295-9b4b-70e53ec9a057 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:03.204504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856f59-f50d-4295-9b4b-70e53ec9a057 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:03.204795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856f59-f50d-4295-9b4b-70e53ec9a057 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:03.205976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856f59-f50d-4295-9b4b-70e53ec9a057 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:03.207427 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c856f59-f50d-4295-9b4b-70e53ec9a057 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:03.214166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 112/222] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:03 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:03.216673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:03.325547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c51df-e96b-41f2-a875-72f67cba9272 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:03.343316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:03.367483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:03.368112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:03.369363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:03.369363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:03.370538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] RBAC: Adding query filter params (role.id=57e51448d348447ca4273f4e2a3f996d, scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f, user.id=7f04db083ef549179aa2f33c5c973013) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:03.370538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:03.371375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2303ff8-6e74-426c-a653-3bb957829f4a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:03.378351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 111/223] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:03 2022] GET /identity/v3/role_assignments?user.id=7f04db083ef549179aa2f33c5c973013&scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f&role.id=57e51448d348447ca4273f4e2a3f996d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:04.637752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95c74-873b-47c8-91f8-1080fc8a2132 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:04.638298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95c74-873b-47c8-91f8-1080fc8a2132 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:04.638298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc95c74-873b-47c8-91f8-1080fc8a2132 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:04.639635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 113/224] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:04.645375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a54228-0245-44de-aa0a-66d931716c9d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:04.645847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a54228-0245-44de-aa0a-66d931716c9d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:04.645997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a54228-0245-44de-aa0a-66d931716c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:04.667343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a7a54228-0245-44de-aa0a-66d931716c9d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:04.668606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a7a54228-0245-44de-aa0a-66d931716c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:04.705652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a99b-02ab-4727-98b4-437d6f6ae8e3 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:04.705935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a99b-02ab-4727-98b4-437d6f6ae8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:04.706387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0a99b-02ab-4727-98b4-437d6f6ae8e3 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:04.707717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 114/225] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:04.713450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:04.713735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:04.714012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:04.731113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:04.732280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:04.734489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:04.738692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 112/226] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:04.741194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efed7b-f806-4a07-b211-211e92b096b0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:04.741483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efed7b-f806-4a07-b211-211e92b096b0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:04.741759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efed7b-f806-4a07-b211-211e92b096b0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:04.743139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 113/227] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:04.748523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:04.748809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:04.749245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:04.767333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:04.768525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:04.806574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 115/228] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:04.840031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 114/229] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:05.011422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.078026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.121543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.125650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5eac-7f03-46e3-9de3-37e9c30cd42d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.159615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.160249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.160559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.160858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.167630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.171552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:05.177426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:05.178841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:05.179683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 116/230] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:05.180368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.180476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d50d2-abe4-4989-b3b9-762f476ddea7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.217159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.217785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.218063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.218332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.228532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:05.233706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:05.234563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:05.235373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 115/231] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:05.236012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.288964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c90c9-2b26-44c8-8f00-6ae919941317 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.325519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.326160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.326435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.326706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.327810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.329302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.332510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 117/232] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:05.332510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.350919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.354911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bbc1f-e6ef-422c-81f7-9a64628bc7b0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.394272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.395148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.395689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.396123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.396953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:05.397539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.399176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.407443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 116/233] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:05.408305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.426110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.462383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8230a-fa00-4fc4-bbde-48ab854925e6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.499159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.500060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.500634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.501189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.501996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:05.502297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.503674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.512534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 118/234] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:05.512666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.515083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a28f3-21ac-4dd2-bbd0-71df12a70e8b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.551954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.552638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.554319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.554319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] PATH_INFO: `/v3/groups` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.554509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.556017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.615317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edef69b-49ce-44cf-a919-b101eab3d5e6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.636421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 117/235] 10.222.0.13 () {60 vars in 1134 bytes} [Fri Oct 14 02:49:05 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:05.636421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.643903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.652021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.652722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.653007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.653281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] PATH_INFO: `/v3/users/8b9e77bcf14948d7846e83134273a048` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.669754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] RBAC: Authorizing `identity:get_user(user_id=8b9e77bcf14948d7846e83134273a048)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.671265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.678881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 119/236] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/users/8b9e77bcf14948d7846e83134273a048 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:05.680061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.680645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.768707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f873c-baf2-4175-98a7-fa9c804e7b03 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.792865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddcb77-b7cd-43a0-a36a-50dffd99ed95 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.810230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.810799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.811088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.811358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] PATH_INFO: `/v3/users/bb3a69546d494914bfb64dcb892f9397` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.813079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] RBAC: Authorizing `identity:get_user(user_id=bb3a69546d494914bfb64dcb892f9397)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.814602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.816475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 118/237] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/users/bb3a69546d494914bfb64dcb892f9397 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:05.821740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:05.835643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.836332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.836629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.836821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.837571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] RBAC: Adding query filter params (role.id=57e51448d348447ca4273f4e2a3f996d, user.id=8b9e77bcf14948d7846e83134273a048, scope.system=all) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:05.837879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.839303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999e898-6677-4fda-8eca-72c9c9db79d3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:05.845089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 120/238] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Oct 14 02:49:05 2022] GET /identity/v3/role_assignments?user.id=8b9e77bcf14948d7846e83134273a048&scope.system=all&role.id=57e51448d348447ca4273f4e2a3f996d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:05.923385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:05.933598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8786c71-9815-4535-8527-daab0e9d502c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:05.969741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09864a99-5e17-49b0-8a6d-bd4efaa96b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:05.970408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09864a99-5e17-49b0-8a6d-bd4efaa96b2d None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:05.970687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09864a99-5e17-49b0-8a6d-bd4efaa96b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:05.970960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09864a99-5e17-49b0-8a6d-bd4efaa96b2d None admin] PATH_INFO: `/v3/system/users/bb3a69546d494914bfb64dcb892f9397/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:05.972461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09864a99-5e17-49b0-8a6d-bd4efaa96b2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bb3a69546d494914bfb64dcb892f9397, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:05.973896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09864a99-5e17-49b0-8a6d-bd4efaa96b2d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:06.064668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 119/239] 10.222.0.13 () {58 vars in 1334 bytes} [Fri Oct 14 02:49:05 2022] PUT /identity/v3/system/users/bb3a69546d494914bfb64dcb892f9397/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:49:07.822147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043026-a0ee-4783-9a84-e9fcd3e8bf5e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:07.822681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043026-a0ee-4783-9a84-e9fcd3e8bf5e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:07.822681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45043026-a0ee-4783-9a84-e9fcd3e8bf5e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:07.824044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 121/240] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:07.829344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04b08-7e38-42e3-82fc-2305a65bf6d2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:07.829727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04b08-7e38-42e3-82fc-2305a65bf6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:07.829901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de04b08-7e38-42e3-82fc-2305a65bf6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:07.848633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2de04b08-7e38-42e3-82fc-2305a65bf6d2 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:07.849857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2de04b08-7e38-42e3-82fc-2305a65bf6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:07.921420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 120/241] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:07.987526 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dbf52-f2b1-40db-8847-fa83431b4a48 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:07.987732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dbf52-f2b1-40db-8847-fa83431b4a48 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:07.988168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dbf52-f2b1-40db-8847-fa83431b4a48 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:07.989694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 122/242] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:07.995610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e16a1-b801-4927-9ca9-180ab62b0e09 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:07.995903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e16a1-b801-4927-9ca9-180ab62b0e09 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:07.996185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e16a1-b801-4927-9ca9-180ab62b0e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.014774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-069e16a1-b801-4927-9ca9-180ab62b0e09 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:08.016213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-069e16a1-b801-4927-9ca9-180ab62b0e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:08.089207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 121/243] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:08.168010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ace6-17c7-49c3-8afa-6d9b67ae201c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.168577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ace6-17c7-49c3-8afa-6d9b67ae201c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.168995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808ace6-17c7-49c3-8afa-6d9b67ae201c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.170464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 123/244] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:08.175829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.176116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.176761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.187487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ace6-17c7-49c3-8afa-6d9b67ae201c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.197213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:08.198405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:08.208670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:08.242731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:08.269684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 122/245] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:08.294557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808ace6-17c7-49c3-8afa-6d9b67ae201c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.328682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.329308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.329586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.329857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.331003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:08.332466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:08.334226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 124/246] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:08.339468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.365841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.442366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90730691-999b-460e-bbd1-a4eec49b150f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.476163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a65e72-0745-403a-bdd8-8beb54cc25c0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.477215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.477827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.478108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.478381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] PATH_INFO: `/v3/groups` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.479022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:08.480493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:08.499792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:08.511676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.512303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.512622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.512899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.523252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:08.528004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:08.529104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 125/247] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:08.533446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.576422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 123/248] 10.222.0.13 () {60 vars in 1134 bytes} [Fri Oct 14 02:49:08 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:08.576422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.579192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:08.648147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29055e75-4ca5-4874-9e1e-ec659636c90a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.687417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.688167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.688566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.688849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.702280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:08.703237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2efec9-802a-4540-bb82-a2fccf6894eb None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:08.707729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:08.709469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:08.713349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 126/249] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:08.715407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.747211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.747211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.747510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.747723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.748446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:08.748790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:08.750226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:08.760248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 124/250] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:08.763305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:08.766230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.838741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3cc1a-6f00-4e6d-9362-59605f0cfe0c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.853033 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:08.893103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.893980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.894406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.894823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.895652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:08.896021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:08.897990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:08.901240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9a264-1814-4b97-80aa-1c64751d0f4f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:08.908578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 127/251] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:08.917494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:08.937447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:08.938087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:08.938371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:08.938644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] PATH_INFO: `/v3/users/8b9e77bcf14948d7846e83134273a048` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:08.939786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] RBAC: Authorizing `identity:get_user(user_id=8b9e77bcf14948d7846e83134273a048)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:08.941269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:08.942858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 125/252] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/users/8b9e77bcf14948d7846e83134273a048 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:08.949757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:09.045951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:09.049075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cecf0c-53b6-45d8-a411-b8e0bb4ba5bf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:09.082963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a20b54-1f87-4292-9c87-a95b67c063aa None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:09.102985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:09.103862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:09.104145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:09.104439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] PATH_INFO: `/v3/users/bb3a69546d494914bfb64dcb892f9397` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:09.105954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] RBAC: Authorizing `identity:get_user(user_id=bb3a69546d494914bfb64dcb892f9397)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:09.107406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:09.109982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 128/253] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:08 2022] GET /identity/v3/users/bb3a69546d494914bfb64dcb892f9397 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:09.116091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:09.132246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553988d6-409d-4257-bf12-1900e7f6e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:09.133008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553988d6-409d-4257-bf12-1900e7f6e6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:09.133287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553988d6-409d-4257-bf12-1900e7f6e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:09.133557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553988d6-409d-4257-bf12-1900e7f6e6d9 None admin] PATH_INFO: `/v3/system/users/8b9e77bcf14948d7846e83134273a048/roles/57e51448d348447ca4273f4e2a3f996d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:09.134982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553988d6-409d-4257-bf12-1900e7f6e6d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b9e77bcf14948d7846e83134273a048, role_id=57e51448d348447ca4273f4e2a3f996d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:09.136461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553988d6-409d-4257-bf12-1900e7f6e6d9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:09.138007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:09.179553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 126/254] 10.222.0.13 () {58 vars in 1334 bytes} [Fri Oct 14 02:49:08 2022] PUT /identity/v3/system/users/8b9e77bcf14948d7846e83134273a048/roles/57e51448d348447ca4273f4e2a3f996d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:49:09.234459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c616-c57f-43d8-9466-3e8cd0cbf6fe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:09.274829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:09.275462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:09.275740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:09.276010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:09.276782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] RBAC: Adding query filter params (role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, user.id=bb3a69546d494914bfb64dcb892f9397, scope.system=all) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:09.277086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:09.278612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a12911-6a8d-4bd3-abea-5d22da575186 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:09.292589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 129/255] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Oct 14 02:49:09 2022] GET /identity/v3/role_assignments?user.id=bb3a69546d494914bfb64dcb892f9397&scope.system=all&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:10.932270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e783-1e9a-4a5d-bcc4-348a16fecfa6 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:10.932803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e783-1e9a-4a5d-bcc4-348a16fecfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:10.932803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e783-1e9a-4a5d-bcc4-348a16fecfa6 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:10.934108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 127/256] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:10.939644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b28481-7f93-4543-826b-aec6be3c4ecf None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:10.940085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b28481-7f93-4543-826b-aec6be3c4ecf None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:10.940281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b28481-7f93-4543-826b-aec6be3c4ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:10.962854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b6b28481-7f93-4543-826b-aec6be3c4ecf None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:10.964046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b6b28481-7f93-4543-826b-aec6be3c4ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:10.996678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:11.038552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 130/257] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 02:49:11.471305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d1ea-85cd-442f-8870-51725d7d95e3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.471985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d1ea-85cd-442f-8870-51725d7d95e3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.472511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d1ea-85cd-442f-8870-51725d7d95e3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.474275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 128/258] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:11.480625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.480916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.481190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.508577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:11.509769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:11.518858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 131/259] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 02:49:11.597583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94d1ea-85cd-442f-8870-51725d7d95e3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:11.614530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94d1ea-85cd-442f-8870-51725d7d95e3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:11.622782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:11.623654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.624178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.624676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.641329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:11.647062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:11.647943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:11.648767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:11.661184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 129/260] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:11.666942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:11.681253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4de21f-9ae4-404e-a87d-bc4c0bf2b77d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:11.694492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:11.695112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.695387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.695654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.696418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:11.696723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:11.698522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 02:49:11.698522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 02:49:11.698522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 02:49:11.699446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:11.713316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 132/261] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:49:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:11.719038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:11.733802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069db1d2-6d54-41ab-8fae-1b34e1f599ec admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:11.744610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:11.745547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.746030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.746521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.758240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:11.760317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 02:49:11.760317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 02:49:11.760317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 02:49:11.761897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:11.764093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 130/262] 10.222.0.13 () {56 vars in 1201 bytes} [Fri Oct 14 02:49:11 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:11.769777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:11.785578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5badd4-d096-4bff-84cf-239b56d128fe admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:11.794489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:11.795127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.795406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.795680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.801133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:11.803752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:11.805662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 133/263] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Oct 14 02:49:11 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:11.811441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:11.825999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621a09f-f704-4638-a236-451e47f753cc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:11.836466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:11.837379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:11.837860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:11.838358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/groups/e73abc8f5f724008a25c94f4534697d9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:11.845659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da7b921e04a475db00a4d75aebb7c8f, group_id=e73abc8f5f724008a25c94f4534697d9, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:11.846937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 02:49:11.846937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 02:49:11.846937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 02:49:11.849280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:11.926746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 131/264] 10.222.0.13 () {58 vars in 1463 bytes} [Fri Oct 14 02:49:11 2022] PUT /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/groups/e73abc8f5f724008a25c94f4534697d9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:12.012424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.023177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd514a1-59c4-45c0-b485-354329a2899b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.104981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.105638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.105918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.106191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.119597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:12.125322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:12.126280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:12.127072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:12.131137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 134/265] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Oct 14 02:49:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:12.134897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.151574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0869-0f07-4909-bc3b-2f35058a29f3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.166204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.169583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.169583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.169583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.169583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:12.169583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:12.170445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 02:49:12.170445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 02:49:12.170445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 02:49:12.171844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:12.185420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 132/266] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Oct 14 02:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:12.191412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.204986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc76b37-6383-48a7-bb81-ab77b4f290ec admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.212878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.213527 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.213844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.214122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.221239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:12.222299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 02:49:12.222299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 02:49:12.222299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 02:49:12.223538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:12.226344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 135/267] 10.222.0.13 () {56 vars in 1201 bytes} [Fri Oct 14 02:49:12 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:12.231780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.248164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde70c02-5bc3-49ac-9587-ea284c30e7f4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.255556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3995e6-3012-4bfe-971c-83d5740eef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.256479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3995e6-3012-4bfe-971c-83d5740eef2b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.264532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3995e6-3012-4bfe-971c-83d5740eef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.264532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3995e6-3012-4bfe-971c-83d5740eef2b admin admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.264532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3995e6-3012-4bfe-971c-83d5740eef2b admin admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:12.264532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3995e6-3012-4bfe-971c-83d5740eef2b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:12.266305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 133/268] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Oct 14 02:49:12 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:12.277999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.283719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6883db-9dd4-4f84-9a6d-67b40bf89474 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.284343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6883db-9dd4-4f84-9a6d-67b40bf89474 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.284836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6883db-9dd4-4f84-9a6d-67b40bf89474 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.287312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 134/269] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:12.292599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305baa03-5f92-4151-b952-66bcbde0708f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.293293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcf995-57c8-4e3b-b272-f0b461289d1b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.293777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcf995-57c8-4e3b-b272-f0b461289d1b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.294245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcf995-57c8-4e3b-b272-f0b461289d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.299661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.300329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.300634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.300909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/groups/e73abc8f5f724008a25c94f4534697d9/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.306658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da7b921e04a475db00a4d75aebb7c8f, group_id=e73abc8f5f724008a25c94f4534697d9, role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:12.308688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 02:49:12.308688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 02:49:12.308688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 02:49:12.310671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fcc73-707e-4d99-9d1b-36cb77a79602 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:12.324626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-89bcf995-57c8-4e3b-b272-f0b461289d1b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:12.326245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-89bcf995-57c8-4e3b-b272-f0b461289d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:12.338872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 135/270] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 02:49:12.383931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 136/271] 10.222.0.13 () {58 vars in 1463 bytes} [Fri Oct 14 02:49:12 2022] PUT /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f/groups/e73abc8f5f724008a25c94f4534697d9/roles/6758e63c58de49968859f2dd43ea8a24 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:12.760500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0465b-d8ef-4f23-97c2-b62b0ef9d1cb None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.761190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0465b-d8ef-4f23-97c2-b62b0ef9d1cb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.761663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0465b-d8ef-4f23-97c2-b62b0ef9d1cb None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.763497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 136/272] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:12.769036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a278c-6ff8-4c06-a433-8a86f26d8faf None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.769554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a278c-6ff8-4c06-a433-8a86f26d8faf None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.770007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a278c-6ff8-4c06-a433-8a86f26d8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.775914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec0e1-3368-4058-9494-47b7b59d70d2 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.776424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec0e1-3368-4058-9494-47b7b59d70d2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.776925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceec0e1-3368-4058-9494-47b7b59d70d2 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.778807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 137/273] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:12.781560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec0e1-3368-4058-9494-47b7b59d70d2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.794843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4d5a278c-6ff8-4c06-a433-8a86f26d8faf None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:12.796370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4d5a278c-6ff8-4c06-a433-8a86f26d8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:12.893057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceec0e1-3368-4058-9494-47b7b59d70d2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.904289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.905013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.905292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.905563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.907321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 137/274] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:12.908833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.909122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.909397 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.927632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:12.936783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:12.937699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:12.938902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 138/275] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:12.941637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:12.948781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:12.949970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:12.953012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:12.965943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163dfae-4aa6-467c-b95a-c72065364354 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:12.972741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 138/276] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 14 02:49:12.975728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:12.976683 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:12.977163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:12.977632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:12.978502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:12.979001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:12.980890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.000028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 139/277] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:13.005978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.022748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02056b0-c299-4367-a806-9c89e709bfb8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.037934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.038579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.038858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.039129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.045052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.046986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.048892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 139/278] 10.222.0.13 () {56 vars in 1201 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:13.054394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.066204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7f4be-ced6-4444-ba7a-80371c96080f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.076420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.077367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.077848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.078318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.085057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.091386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.093433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 140/279] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:13.099683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.113911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aea190-5750-4a15-b1bc-14fa345a1bcc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.124473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.125145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.125425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.125704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/groups/e73abc8f5f724008a25c94f4534697d9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.133662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f, group_id=e73abc8f5f724008a25c94f4534697d9, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.136321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.224458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 140/280] 10.222.0.13 () {58 vars in 1463 bytes} [Fri Oct 14 02:49:13 2022] PUT /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/groups/e73abc8f5f724008a25c94f4534697d9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:13.383593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.395265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c538bb8-24e1-410b-b9d6-82d6339aa10d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.424954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.462568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.463578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.464083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.464600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.476706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:13.482296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:13.483237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:13.484034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:13.486594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 141/281] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:13.493530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.506276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6ef51-2dff-48d9-b3a9-8fc25c14be36 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.512554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.513631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.514110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.514583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.515717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:13.516216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.518187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.529820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 142/282] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:13.536239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.546762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cd01c-b3dd-47be-9fde-d11a68c6f7ed admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.548002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:13.554862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.558764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.558764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.558764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.558764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.560431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.562655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 143/283] 10.222.0.13 () {56 vars in 1201 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:13.567790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.581976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d71b2-e3dc-4f3a-9337-74da3f204e1f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.582161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd680cdf-c385-4b4f-9788-a02b30bb7b5c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.591542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.592713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.593255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.593816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.595972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.616546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.616546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 144/284] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:13.616546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.622087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c271-31ba-410b-8683-d3c875c6a0a3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.626151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.626800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.627078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.627472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.629601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.630647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.631191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.631708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/groups/e73abc8f5f724008a25c94f4534697d9/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.636946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f, group_id=e73abc8f5f724008a25c94f4534697d9, role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.638792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:13.640697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:13.643878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:13.644790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:13.647019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 141/285] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:13.656704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.720621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:13.738467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 145/286] 10.222.0.13 () {58 vars in 1463 bytes} [Fri Oct 14 02:49:13 2022] PUT /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f/groups/e73abc8f5f724008a25c94f4534697d9/roles/6758e63c58de49968859f2dd43ea8a24 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:49:13.783267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9537b-2fe8-44a7-bd95-d1af8409c9f0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:13.822251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:13.822866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.823144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.823417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.824092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:13.824416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:13.825827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4c646-a911-41ed-b1bf-c18b075a3d1f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:13.834694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 142/287] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:13.840586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:13.864474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0f5f-0789-42e9-b8f1-bc0091685ea7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.864474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0f5f-0789-42e9-b8f1-bc0091685ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.864474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0f5f-0789-42e9-b8f1-bc0091685ea7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.865722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 143/288] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:13.871103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:13.871589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:13.871876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:13.893089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:13.894888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:13.964426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 144/289] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 14 02:49:14.004231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0989a9-84ea-4594-a358-b2316c0e55cf admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.050398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.051335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.051763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.052188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] PATH_INFO: `/v3/users/8b9e77bcf14948d7846e83134273a048` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.057444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] RBAC: Authorizing `identity:get_user(user_id=8b9e77bcf14948d7846e83134273a048)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:14.059296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:14.061202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 146/290] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:49:13 2022] GET /identity/v3/users/8b9e77bcf14948d7846e83134273a048 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:14.067444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:14.150160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:14.214153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409daf8-72cb-40e2-9d55-42472cbcf21e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.256153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.256718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.257001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.257278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.258012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] RBAC: Adding query filter params (role.id=57e51448d348447ca4273f4e2a3f996d, user.id=8b9e77bcf14948d7846e83134273a048, scope.system=all) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:14.258328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:14.259765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:14.275983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 145/291] 10.222.0.13 () {56 vars in 1308 bytes} [Fri Oct 14 02:49:14 2022] GET /identity/v3/role_assignments?user.id=8b9e77bcf14948d7846e83134273a048&scope.system=all&role.id=57e51448d348447ca4273f4e2a3f996d => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:14.428486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:14.441214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98d572-0a08-430b-915b-c408764566dd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.447352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.447998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.448283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.448614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.464699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:14.469841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:14.470783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:14.472197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 147/292] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:14.477582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:14.489164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979e899-fbe1-4271-87cf-acc5a8c4fa3d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.495392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.496011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.496293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.496601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.497282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:14.497592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:14.499335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:14.509124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 146/293] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:14.514816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:14.526775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8849-d0c2-4b80-a2fe-a6c5d3c20bd7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.531648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.532190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.532513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.532789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] PATH_INFO: `/v3/groups/41eb996aeb9e43b38ed5c31a79a6b3d6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.539224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] RBAC: Authorizing `identity:get_group(group_id=41eb996aeb9e43b38ed5c31a79a6b3d6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:14.541270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:14.543223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 148/294] 10.222.0.13 () {56 vars in 1201 bytes} [Fri Oct 14 02:49:14 2022] GET /identity/v3/groups/41eb996aeb9e43b38ed5c31a79a6b3d6 => generated 229 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:14.548997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:14.559938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa56c0e-1849-44c4-acb4-4231f64208ab admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.567326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781c320-141a-4da5-8119-9441ba8f0901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.568114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781c320-141a-4da5-8119-9441ba8f0901 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.568410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781c320-141a-4da5-8119-9441ba8f0901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.568703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781c320-141a-4da5-8119-9441ba8f0901 admin admin] PATH_INFO: `/v3/projects/1ee22ef683e5495db6f46559187e0847` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.570092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781c320-141a-4da5-8119-9441ba8f0901 admin admin] RBAC: Authorizing `identity:get_project(project_id=1ee22ef683e5495db6f46559187e0847)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:14.572046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781c320-141a-4da5-8119-9441ba8f0901 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:14.574213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 147/295] 10.222.0.13 () {56 vars in 1207 bytes} [Fri Oct 14 02:49:14 2022] GET /identity/v3/projects/1ee22ef683e5495db6f46559187e0847 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:14.580036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:14.594073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd09d-3221-482b-b109-5ae49df82557 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:14.600653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efadd08e-0912-434d-a865-9b641d2607c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:14.601635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadd08e-0912-434d-a865-9b641d2607c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:14.602115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadd08e-0912-434d-a865-9b641d2607c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:14.602657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efadd08e-0912-434d-a865-9b641d2607c7 admin admin] PATH_INFO: `/v3/projects/1ee22ef683e5495db6f46559187e0847/groups/41eb996aeb9e43b38ed5c31a79a6b3d6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:14.609334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadd08e-0912-434d-a865-9b641d2607c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee22ef683e5495db6f46559187e0847, group_id=41eb996aeb9e43b38ed5c31a79a6b3d6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:14.612569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efadd08e-0912-434d-a865-9b641d2607c7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:14.699590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 149/296] 10.222.0.13 () {58 vars in 1463 bytes} [Fri Oct 14 02:49:14 2022] PUT /identity/v3/projects/1ee22ef683e5495db6f46559187e0847/groups/41eb996aeb9e43b38ed5c31a79a6b3d6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:15.259520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c539ab-e2a3-47f9-af13-bf73f085e3fb None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:15.260568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c539ab-e2a3-47f9-af13-bf73f085e3fb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:15.261071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c539ab-e2a3-47f9-af13-bf73f085e3fb None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:15.262901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 148/297] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:15.269478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b234-1aad-46c5-9b3f-32afbc90888f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:15.270046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b234-1aad-46c5-9b3f-32afbc90888f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:15.270543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b234-1aad-46c5-9b3f-32afbc90888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:15.289874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6cb7b234-1aad-46c5-9b3f-32afbc90888f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:15.291395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6cb7b234-1aad-46c5-9b3f-32afbc90888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:15.305948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:15.364331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 150/298] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:15.655668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c539ab-e2a3-47f9-af13-bf73f085e3fb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:15.792712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:15.799384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c539ab-e2a3-47f9-af13-bf73f085e3fb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:15.814173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01c75-63e8-41c7-88f4-ff325fabf9b1 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:15.815515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01c75-63e8-41c7-88f4-ff325fabf9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:15.816016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01c75-63e8-41c7-88f4-ff325fabf9b1 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:15.821871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 151/299] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:15.826256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:15.826772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:15.827265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:15.849784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:15.850431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:15.850714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:15.850975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:15.855402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:15.857202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:15.871328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:15.876812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:15.881341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:15.882165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 149/300] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:15.886435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:15.991047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 152/301] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:16.069929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fae88b-a7ff-4f8c-adf5-5bbe23824da8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:16.117089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:16.117707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.117987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.118260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.118928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:16.119232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:16.120642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:16.129411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 150/302] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:16.135401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:16.253787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:16.284273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ee0d6-2b90-4f5c-9479-3ece74c2e43e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:16.332072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a3be8-cbdc-4ca7-88f7-f519f112f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:16.332718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a3be8-cbdc-4ca7-88f7-f519f112f30f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.333000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a3be8-cbdc-4ca7-88f7-f519f112f30f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.333273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a3be8-cbdc-4ca7-88f7-f519f112f30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.361791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:16.399913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:16.417608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a3be8-cbdc-4ca7-88f7-f519f112f30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:16.419084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a3be8-cbdc-4ca7-88f7-f519f112f30f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:16.510248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7d0e5-dece-40e7-9044-bd6cc33af0fa None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:16.517560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:16.552143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 153/303] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:16.553532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c37ea-aeff-4dcd-959c-4295afc4a90b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.553821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c37ea-aeff-4dcd-959c-4295afc4a90b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.554095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c37ea-aeff-4dcd-959c-4295afc4a90b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.555343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 154/304] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:16.562232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6fa6-f1b6-4685-bb37-296e16b094f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:16.562888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6fa6-f1b6-4685-bb37-296e16b094f4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.563230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6fa6-f1b6-4685-bb37-296e16b094f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.563541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6fa6-f1b6-4685-bb37-296e16b094f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.563638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c37ea-aeff-4dcd-959c-4295afc4a90b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:16.577855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d6fa6-f1b6-4685-bb37-296e16b094f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-966d6fa6-f1b6-4685-bb37-296e16b094f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:16.585900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:16.586768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:16.587549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:16.588134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 151/305] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:16.592411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.592411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.592411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.617072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:16.618857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:16.699269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c37ea-aeff-4dcd-959c-4295afc4a90b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:16.715377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 152/306] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:16.716753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:16.729884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:16.743968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:16.744655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.744935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.745209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.746475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:16.748321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:16.750875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 155/307] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:16.756732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:16.826695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:16.873796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43c94-214d-4689-8c44-8f0dc5d77980 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:16.935051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb675dfc-90e4-4030-b566-3acfa85383de None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:16.939730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:16.940352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.940668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.940941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.941621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:16.941928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:16.943845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:16.956748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 153/308] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:16.963265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:16.975482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:16.976328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:16.976763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:16.977199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:16.978447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:16.980010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:16.981749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 156/309] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:16.997258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.085039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:17.127483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ac28b-865f-4b64-a479-993820247e7b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.164671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdab069-ccd6-40a9-ab7a-16e95ec88ad4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.170944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee633177-c00e-4264-95d6-09b585f67ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.173318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee633177-c00e-4264-95d6-09b585f67ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.173609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee633177-c00e-4264-95d6-09b585f67ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.173887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee633177-c00e-4264-95d6-09b585f67ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.180736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:17.206960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.207570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.207849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.208120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.208914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] RBAC: Adding query filter params (group.id=e73abc8f5f724008a25c94f4534697d9, role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, scope.project.id=4da7b921e04a475db00a4d75aebb7c8f) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:17.209216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:17.210763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:17.218002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 157/310] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/role_assignments?group.id=e73abc8f5f724008a25c94f4534697d9&scope.project.id=4da7b921e04a475db00a4d75aebb7c8f&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:17.218756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.260948 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee633177-c00e-4264-95d6-09b585f67ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:17.262950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee633177-c00e-4264-95d6-09b585f67ca8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:17.344955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390a832-d995-49fe-89eb-66bd02547b9c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.368248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:17.399093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3e803-e527-413f-b88c-de6b6e25337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.399974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e803-e527-413f-b88c-de6b6e25337e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.400358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e803-e527-413f-b88c-de6b6e25337e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.400856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3e803-e527-413f-b88c-de6b6e25337e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.411148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 154/311] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:17.416155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7631bc-35c7-471d-89c1-71da3f217b25 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.416155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7631bc-35c7-471d-89c1-71da3f217b25 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.416155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7631bc-35c7-471d-89c1-71da3f217b25 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.416417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 155/312] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:17.418549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3e803-e527-413f-b88c-de6b6e25337e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:17.425036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7631bc-35c7-471d-89c1-71da3f217b25 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e0d3e803-e527-413f-b88c-de6b6e25337e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:17.425621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:17.426464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:17.427866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 158/313] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:17.432342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.432645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.432973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.454917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:17.456567 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:17.506037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:17.562083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 159/314] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:17.565344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.580771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7631bc-35c7-471d-89c1-71da3f217b25 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.626998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996534-b295-4617-af6a-34289e1166ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.628149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996534-b295-4617-af6a-34289e1166ad None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.628894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996534-b295-4617-af6a-34289e1166ad None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.629347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16996534-b295-4617-af6a-34289e1166ad None admin] PATH_INFO: `/v3/projects/4da7b921e04a475db00a4d75aebb7c8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.631312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16996534-b295-4617-af6a-34289e1166ad None admin] RBAC: Authorizing `identity:get_project(project_id=4da7b921e04a475db00a4d75aebb7c8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:17.633652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16996534-b295-4617-af6a-34289e1166ad None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:17.636076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 156/315] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:17 2022] GET /identity/v3/projects/4da7b921e04a475db00a4d75aebb7c8f => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:17.642474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996534-b295-4617-af6a-34289e1166ad None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.695353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c20d8-309e-43b8-a6bc-2e42ee1430ac None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.706784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:17.742747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.743783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.744344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.744932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.745898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] RBAC: Adding query filter params (name=member) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:17.747253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:17.750178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:17.761073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 160/316] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:49:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:17.768415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.791204 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16996534-b295-4617-af6a-34289e1166ad None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.818224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:17.845230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492039f-849f-414d-9885-c2bf78bf1827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.846014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492039f-849f-414d-9885-c2bf78bf1827 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.846413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492039f-849f-414d-9885-c2bf78bf1827 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.846694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492039f-849f-414d-9885-c2bf78bf1827 None admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.847976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492039f-849f-414d-9885-c2bf78bf1827 None admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:17.851272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4492039f-849f-414d-9885-c2bf78bf1827 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:17.853829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 157/317] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Oct 14 02:49:17 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:17.855543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3bc66-42d7-434f-b906-9dc781fe4fb6 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.855826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3bc66-42d7-434f-b906-9dc781fe4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.856098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3bc66-42d7-434f-b906-9dc781fe4fb6 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.859398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 158/318] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:17.860076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3bc66-42d7-434f-b906-9dc781fe4fb6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:17.898574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3fe1-b379-48d4-999e-c05c0db36983 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.938377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:17.939907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:17.940632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:17.940632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:17.976575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3bc66-42d7-434f-b906-9dc781fe4fb6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:17.986547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.016820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.017970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.018253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.018528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.019257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] RBAC: Adding query filter params (group.id=e73abc8f5f724008a25c94f4534697d9, role.id=6758e63c58de49968859f2dd43ea8a24, scope.project.id=4da7b921e04a475db00a4d75aebb7c8f) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:18.019566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.021622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c4943-2447-4701-bfbf-9821aef62557 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.028198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.028361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 159/319] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Oct 14 02:49:17 2022] GET /identity/v3/role_assignments?group.id=e73abc8f5f724008a25c94f4534697d9&scope.project.id=4da7b921e04a475db00a4d75aebb7c8f&role.id=6758e63c58de49968859f2dd43ea8a24 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:18.029436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.029562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.029726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.029994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.050402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:18.051398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:18.072804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.139464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:18.140417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.179911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 161/321] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 14 02:49:18.186182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.264974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.268430 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2408a-d38c-4601-b063-7c4e43d305ff None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.315159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.315800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.316083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.316361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.318038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a29288-e389-4a7a-a4cf-924df335f6fe None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.329584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:18.335036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:18.335923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:18.337267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 161/322] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:18.342114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.356981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.365187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.370961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.370961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.370961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.370961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.370961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.371670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 162/323] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:18.378519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.467774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc637a58-582a-43e9-9ae1-b1a0149e82ce None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.510120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2205ba-2bcb-4ef4-89ec-fec0ffe43da3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.510483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.511095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.511378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.511651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.512325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:18.512737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.514135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.523798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 162/324] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:18.528697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.550828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.551467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.551753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.552624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.554220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.555674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.555995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.558077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 163/325] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:18.558880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.635566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.638350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6170-3ec4-42a5-adae-b88597e59764 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.676324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fe57d-3acd-4875-bfb4-cf12ef63bdcd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.685144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.685778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.686057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.686329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.698406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:18.703290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:18.704214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:18.705388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 163/326] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:18.706199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.723810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.724350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.724687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.724966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.798291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.804343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.805912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.820898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64353-643e-49c6-a1f4-a095b4caba8c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:18.864176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:18.867370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:18.867370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:18.867370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:18.867370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] RBAC: Adding query filter params (group.id=e73abc8f5f724008a25c94f4534697d9, role.id=1ac71e98bd4841a2b2aeef1cd05a59a5, scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:18.867370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:18.868330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:18.877783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 164/327] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/role_assignments?group.id=e73abc8f5f724008a25c94f4534697d9&scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f&role.id=1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:18.881354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:18.884203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:18.934120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 164/328] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:18.940031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.004498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240ab4-1974-4e3b-b54a-5a5028b0f9ac None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.041703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.042320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.042604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.042878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.043549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:19.043850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.045274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.054687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 165/329] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:19.060378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.072244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:19.073607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c002421-5963-47ae-b503-8192334ac1a8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.117480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.118122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.118407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.119612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] PATH_INFO: `/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.119932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef7a7d7ecf7f440a95cd9c8e468a922f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.121427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.123073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 165/330] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:18 2022] GET /identity/v3/projects/ef7a7d7ecf7f440a95cd9c8e468a922f => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:19.128604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.169857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:19.181759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c284d6-25ae-4231-b179-0d8f882165cd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.229443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.230063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.230347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.230622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.249439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99006-1dfd-4d32-8987-18cf512353a4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.289366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.289923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.290208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.290485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] PATH_INFO: `/v3/groups/e73abc8f5f724008a25c94f4534697d9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.291584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] RBAC: Authorizing `identity:get_group(group_id=e73abc8f5f724008a25c94f4534697d9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.293040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.294604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 166/331] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Oct 14 02:49:19 2022] GET /identity/v3/groups/e73abc8f5f724008a25c94f4534697d9 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:19.300373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.300805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.302262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.311671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:19.398199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19318aaf-a90a-48d3-8f95-95b56fc35442 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.399680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:19.400073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:19.405379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.432235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.432875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.433180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.433463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.434424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] RBAC: Adding query filter params (group.id=e73abc8f5f724008a25c94f4534697d9, role.id=6758e63c58de49968859f2dd43ea8a24, scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:19.434912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.436705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.442301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 167/333] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Oct 14 02:49:19 2022] GET /identity/v3/role_assignments?group.id=e73abc8f5f724008a25c94f4534697d9&scope.project.id=ef7a7d7ecf7f440a95cd9c8e468a922f&role.id=6758e63c58de49968859f2dd43ea8a24 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:19.508141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21a5f2-452d-44a2-ad70-5a7bceeef28d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.518566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:19.545511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.546072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.546358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.546639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] PATH_INFO: `/v3/projects/1ee22ef683e5495db6f46559187e0847` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.547799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] RBAC: Authorizing `identity:get_project(project_id=1ee22ef683e5495db6f46559187e0847)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.549286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.550963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 167/334] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:49:19 2022] GET /identity/v3/projects/1ee22ef683e5495db6f46559187e0847 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:19.556655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.660953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d55a3b-f72f-4506-b445-480574f3c527 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.696016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436fe30-1a7f-40d1-81d5-17f68ed92fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.696700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436fe30-1a7f-40d1-81d5-17f68ed92fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.696978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436fe30-1a7f-40d1-81d5-17f68ed92fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.697250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436fe30-1a7f-40d1-81d5-17f68ed92fc3 None admin] PATH_INFO: `/v3/groups/41eb996aeb9e43b38ed5c31a79a6b3d6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.698354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436fe30-1a7f-40d1-81d5-17f68ed92fc3 None admin] RBAC: Authorizing `identity:get_group(group_id=41eb996aeb9e43b38ed5c31a79a6b3d6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.699796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436fe30-1a7f-40d1-81d5-17f68ed92fc3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.701387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 168/335] 10.222.0.13 () {56 vars in 1180 bytes} [Fri Oct 14 02:49:19 2022] GET /identity/v3/groups/41eb996aeb9e43b38ed5c31a79a6b3d6 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:19.707372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:19.807736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03eb6ff-7330-4e0c-96e4-c365e457b4df None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:19.841344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:19.841944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:19.842224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:19.842498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:19.843224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] RBAC: Adding query filter params (group.id=41eb996aeb9e43b38ed5c31a79a6b3d6, role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=1ee22ef683e5495db6f46559187e0847) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:19.843533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:19.844990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80adc412-c2ef-48a9-9395-645c89abcfb3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:19.850589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 168/336] 10.222.0.13 () {56 vars in 1376 bytes} [Fri Oct 14 02:49:19 2022] GET /identity/v3/role_assignments?group.id=41eb996aeb9e43b38ed5c31a79a6b3d6&scope.project.id=1ee22ef683e5495db6f46559187e0847&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:22.591736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1bcd2-6e27-44fa-b454-ca329b980948 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:22.593024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1bcd2-6e27-44fa-b454-ca329b980948 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:22.593548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1bcd2-6e27-44fa-b454-ca329b980948 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:22.595361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 169/337] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:22.600995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851c47-9d72-4ba4-be01-d2c0292d726e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:22.601439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851c47-9d72-4ba4-be01-d2c0292d726e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:22.601533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76851c47-9d72-4ba4-be01-d2c0292d726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:22.616120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d19d6-8f3d-401d-abbf-d484a15056ef None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:22.616763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d19d6-8f3d-401d-abbf-d484a15056ef None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:22.617254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d19d6-8f3d-401d-abbf-d484a15056ef None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:22.619042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 170/338] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:22.624233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ec50-f94f-4586-8d22-f5420ab91e23 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:22.624550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ec50-f94f-4586-8d22-f5420ab91e23 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:22.624827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4ec50-f94f-4586-8d22-f5420ab91e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:22.634536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-76851c47-9d72-4ba4-be01-d2c0292d726e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:22.635732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-76851c47-9d72-4ba4-be01-d2c0292d726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:22.655584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ddb4ec50-f94f-4586-8d22-f5420ab91e23 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:22.656834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ddb4ec50-f94f-4586-8d22-f5420ab91e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:22.701861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:22.710784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:22.762811 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 169/339] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:22.768537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 171/340] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:22.986869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c819a1-86bf-4fed-a11e-42674f45d385 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:22.987216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c819a1-86bf-4fed-a11e-42674f45d385 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:22.987335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c819a1-86bf-4fed-a11e-42674f45d385 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:22.988998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 170/341] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:22.994151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d933-9862-4264-9b54-14206137266c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:22.994439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d933-9862-4264-9b54-14206137266c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:22.994776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d933-9862-4264-9b54-14206137266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.017302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1139d933-9862-4264-9b54-14206137266c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:23.018808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1139d933-9862-4264-9b54-14206137266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:23.106610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 172/342] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:23.125277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c819a1-86bf-4fed-a11e-42674f45d385 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.128925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d933-9862-4264-9b54-14206137266c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.243727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:23.249141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d933-9862-4264-9b54-14206137266c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.269613 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c819a1-86bf-4fed-a11e-42674f45d385 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.285699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.287018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.287319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.287722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.299150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.301106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.304981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.305607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.305884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.306152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.316280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8cf8692a-fe57-424a-b67b-485e9d845bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:23.317590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:23.318638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:23.319542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:23.319542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:23.319542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:23.319722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.319797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 173/343] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:23.324139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893164-f5ce-4e3f-9441-2a054a997f12 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.324139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893164-f5ce-4e3f-9441-2a054a997f12 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.324139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893164-f5ce-4e3f-9441-2a054a997f12 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.324139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 174/344] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:23.327400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893164-f5ce-4e3f-9441-2a054a997f12 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-788fa1a6-974b-42c5-a840-6cee30f5723d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:23.334776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:23.336918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 171/345] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.339030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.358382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:23.359771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:23.377000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:23.431909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 172/346] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:23.433039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.453981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893164-f5ce-4e3f-9441-2a054a997f12 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.497783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.498317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.498600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.498865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.499506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:23.499805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.501208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.514884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 175/347] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:23.515790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.525882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:23.552116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cb013-a740-44df-ae9f-60e93df012fe None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.590642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.591359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.591646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.591921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.592598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:23.592899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.594466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.613617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 173/348] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:23.615261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.622149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2ccfd-56f8-4cfa-993d-384f90f38d94 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.631965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:23.665635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.666541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.666969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.667388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.681480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.683183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:23.699083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:23.700181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:23.701121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:23.701121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:23.701121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:23.702435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 176/349] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:23.703384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.730028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b043-8a20-40ea-b029-125629ebc575 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.765285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:23.769031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.773962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.773962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.773962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.773962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.773962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.807236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9f88-a11b-4d63-ab9a-54d5537c0506 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:23.840797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:23.841402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:23.841682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:23.841955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:23.842632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:23.844045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:23.862709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 174/350] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:23 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:23.865473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.928159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 177/351] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:23 2022] POST /identity/v3/users => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:23.928159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:23.996642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:24.039241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed855-048b-4b41-b2a4-e0409382514b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:24.063465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de513-6339-40a9-8642-157ed46d5c33 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:24.079699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:24.080327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.080745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.081016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.081673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:24.081805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:24.081977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:24.083452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96eb7b-85a4-4967-9e96-cc29d48f34ad None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:24.097435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 175/352] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:24.099443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0664-3f26-426d-bb79-ff53b092a7bb None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.099734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0664-3f26-426d-bb79-ff53b092a7bb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.100003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0664-3f26-426d-bb79-ff53b092a7bb None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.101558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 176/353] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:24.107374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0664-3f26-426d-bb79-ff53b092a7bb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:24.109996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:24.110799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.111080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.111356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.125505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:24.127095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ad8be75c-71e7-4506-b669-894273adf221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:24.147308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:24.148251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:24.149204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:24.149204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:24.149204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:24.149204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 178/354] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:24.150103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.150211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.150412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.173425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:24.174611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:24.233747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0664-3f26-426d-bb79-ff53b092a7bb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:24.265041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:24.268488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 179/355] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:24.269546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:24.286954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:24.287994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.288505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.288986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.289905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:24.291758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:24.399481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 177/356] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:24 2022] POST /identity/v3/users => generated 248 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:49:24.403848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:24.418875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e087-2ab4-45a0-8423-c58c198c33ed None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:24.467603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:24.468234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.468555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.468832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.469489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:24.469792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:24.471168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:24.486802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 180/357] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:24.495175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:24.585448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:24.638874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8237e6-a056-4abc-91f2-2ba6c5ab0d4a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:24.688832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:24.689458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.689739 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.690017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.690757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:24.692267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:24.730884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a53c7-6663-4c27-880f-6b51c8a2d57d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:24.768408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:24.769049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:24.769446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:24.769720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:24.770946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:24.772325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:24.801046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 178/358] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:24 2022] POST /identity/v3/users => generated 249 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:24.817345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.sql.core [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 02:49:24.817345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 02:49:24.817345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [parameters: {'id': '544acbe5234340e59a8bb317ee6a5969', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 02:49:24.817345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:49:24.825453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return ref.to_dict() Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:49:24.830776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application yield resource Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise self.value Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application session.commit() Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 02:49:24.831720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.flush() Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application compat.raise_( Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 02:49:24.833166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:49:24.834060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:49:24.836746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [parameters: {'id': '544acbe5234340e59a8bb317ee6a5969', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:24.839866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 14 02:49:24.841926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:24.851398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 181/359] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Oct 14 02:49:24 2022] POST /identity/v3/roles => generated 144 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:24.851540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:24.905124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:24.989507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ade63-4edf-44d7-9a68-caacf4892f49 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:25.038027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b052-4930-4425-92f5-c43eaf4b1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:25.038677 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b052-4930-4425-92f5-c43eaf4b1872 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:25.038957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b052-4930-4425-92f5-c43eaf4b1872 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:25.039233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b052-4930-4425-92f5-c43eaf4b1872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:25.054501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4b052-4930-4425-92f5-c43eaf4b1872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4ef4b052-4930-4425-92f5-c43eaf4b1872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:25.059851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:25.060808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:25.061604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 179/360] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:49:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:25.067661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:25.120988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:25.195713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1712f-6c05-466b-adad-fc9327728554 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:25.231339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:25.231952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:25.232235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:25.232586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:25.233261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:25.233564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:25.234927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e865314-04e5-461e-9dff-669ffa8f7772 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:25.244016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 182/361] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:26.314531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0fbb-464a-4ed0-9a15-74b2653680e1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:26.315052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0fbb-464a-4ed0-9a15-74b2653680e1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:26.315052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0fbb-464a-4ed0-9a15-74b2653680e1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:26.316704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 180/362] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:26.322107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5dd4a-57cb-414e-b737-fa3d6290648e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:26.322522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5dd4a-57cb-414e-b737-fa3d6290648e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:26.322707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5dd4a-57cb-414e-b737-fa3d6290648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:26.341298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-34f5dd4a-57cb-414e-b737-fa3d6290648e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:26.342475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-34f5dd4a-57cb-414e-b737-fa3d6290648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:26.443513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 183/363] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:26.490841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86521-a266-409c-841e-e6d8c4acf027 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:26.491168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86521-a266-409c-841e-e6d8c4acf027 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:26.491395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab86521-a266-409c-841e-e6d8c4acf027 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:26.493009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 181/364] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:26.498128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:26.498420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:26.498698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:26.517578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:26.518755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:26.527116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:26.602438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 184/365] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:26.807806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86521-a266-409c-841e-e6d8c4acf027 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:26.877256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:26.953249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:26.960575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab86521-a266-409c-841e-e6d8c4acf027 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.031777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.032444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.032730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.033002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.043352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5c62-b3f4-49de-a3b1-05c03c932d1c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.058058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:27.063385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:27.064338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:27.065157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:27.068790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 182/366] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:27.074268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.133315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c88ea5-81b6-4b9e-b479-d78af8fe6ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.134263 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88ea5-81b6-4b9e-b479-d78af8fe6ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.134717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88ea5-81b6-4b9e-b479-d78af8fe6ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.135211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88ea5-81b6-4b9e-b479-d78af8fe6ac2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.155580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c88ea5-81b6-4b9e-b479-d78af8fe6ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c0c88ea5-81b6-4b9e-b479-d78af8fe6ac2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:27.162550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:27.169370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:27.170178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 185/367] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:27.170821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b19e-430c-4e27-b610-7a4ee0c56140 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.170886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b19e-430c-4e27-b610-7a4ee0c56140 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.171438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974b19e-430c-4e27-b610-7a4ee0c56140 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.172932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 186/368] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:27.174575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b19e-430c-4e27-b610-7a4ee0c56140 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.178518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:27.221059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074dace-1fe7-43e4-a38c-e981d0e47852 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.267265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.268249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.268757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.269244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.270659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:27.271216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:27.273406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12799169-ba6f-4d41-a5c1-63c553dff34b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:27.284503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 183/369] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:27.289977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.290434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.290729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.307895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974b19e-430c-4e27-b610-7a4ee0c56140 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.309794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:27.311483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:27.329021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:27.351219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.352597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.353099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.353572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.354457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:27.354947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:27.356515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:27.367897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 187/370] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:27.369220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.387788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 184/371] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:27.388664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.444177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:27.491403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe9291-7137-4f13-9080-01aee089fb07 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.493566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c801a-f037-43af-8a29-5af28f84dbd7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.544414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.544414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.544414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.544414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.560561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.561206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.561489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.561765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.562789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:27.565775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:27.586533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:27.587469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:27.588748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:27.588748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:27.588748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:27.588748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 185/372] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:27.593644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.597367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:27.597746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:27.599420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:27.632426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:27.633397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:27.634323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:27.634323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:27.634323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:27.634323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 188/373] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:27.642088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.760622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1a6c-b0a4-499c-8b0f-ca3b2c6e6703 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.778692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:27.792884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7810-b327-483f-a4c7-d6ff52fe03a4 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.797433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.798035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.798354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.798619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.799261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:27.799562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:27.801003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fd7ab-bc2f-4952-bbb4-91e579a827c4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:27.814250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 189/374] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:27.817868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91caa5-2561-4b05-a451-566cac9d18ca None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.818365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91caa5-2561-4b05-a451-566cac9d18ca None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.818880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91caa5-2561-4b05-a451-566cac9d18ca None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.820518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 190/375] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:27.822032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91caa5-2561-4b05-a451-566cac9d18ca None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.829895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.830501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.830783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.831059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.831697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:27.831996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:27.833930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:27.845608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 186/376] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:27.846321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:27.913066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:27.937080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91caa5-2561-4b05-a451-566cac9d18ca None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.954139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943bbe4-0fe7-4f9d-9d96-c4b02bfa379b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:27.973430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6421d-661d-4244-bc77-277fbcd917e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.974047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6421d-661d-4244-bc77-277fbcd917e9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.974332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6421d-661d-4244-bc77-277fbcd917e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.974604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6421d-661d-4244-bc77-277fbcd917e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.984784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6421d-661d-4244-bc77-277fbcd917e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4cf6421d-661d-4244-bc77-277fbcd917e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:27.989556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:27.990458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:27.991273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 191/377] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:27.991949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.992023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.992473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:27.992766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:27.993601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:27.994040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:27.994479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.002628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.004879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.010821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:28.011997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:28.018666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:28.019718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 02:49:28.021431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:28.023458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 187/378] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:28.037041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.047542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.087330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 192/379] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:28.088371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.162160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3de026-9bae-49af-b250-1d80fd0db9f8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.195672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.206417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.207127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.208029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.208375 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.217270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.219540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:28.235245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:28.236165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:28.237102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 188/380] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:28.238142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.247005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb6bb3-836f-4931-ac0c-6aca10b718b3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.284715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.285322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.285676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.286324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.286986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:28.287588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.289038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c11b48-0e05-4b38-ac22-fbd91504f4bc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.297366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 193/381] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:28.298373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78a86-ba54-4812-bbad-45f154c8f810 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.298656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78a86-ba54-4812-bbad-45f154c8f810 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.298927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78a86-ba54-4812-bbad-45f154c8f810 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.300267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 194/382] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:28.305392 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d78a86-ba54-4812-bbad-45f154c8f810 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.335121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.352645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418fb2e-ee66-4750-87d0-a1190231f508 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.387642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.388252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.388578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.388852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.389835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:28.390141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.391547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.411427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d78a86-ba54-4812-bbad-45f154c8f810 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.427634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 189/383] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:28.428404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.455309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.455838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.456116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.456407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.457127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:28.457457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.458876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792dc5d4-0d29-45de-99d8-b88f002d94af None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.471977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.501556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 195/384] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:28.503174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.503521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.503799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.522358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:28.523564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:28.539352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ab71-7975-4db2-a2dd-a9df00c1de92 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.573784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.574405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.574681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.574953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.585036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.586498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.591167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 196/385] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:28.592026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:28.603696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:28.604686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:28.605546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:28.605546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:28.605546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:28.605546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 190/386] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:28.610142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.611120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.704876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0bd5-c05b-4a46-bf51-b2f6bd2f70d6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.715804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.722697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deebc5f-7181-4bc4-9d66-66d9139511e2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.742266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.742953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.743238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.743513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.754203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:28.759164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:28.760025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:28.760856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 197/387] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:28.761500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.770555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.771187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.771473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.771746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.782762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.784056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:28.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:28.800471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:28.801917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:28.801917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:28.801917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:28.801917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 191/388] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:28.802138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.851594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:28.876343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b621c-fb76-431e-89c0-5fccb9491003 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.908282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fc961-d5c6-4d6f-9972-f316d0ca5884 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:28.911085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.911706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.911982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.912252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.921986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.923422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:28.939156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:28.940109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:28.940994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:28.940994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:28.940994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:28.940994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 198/389] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:28.941311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.945142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:28.945748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:28.946030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:28.946302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:28.946941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:28.947238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:28.948623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:28.960969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 192/390] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:28.961772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:28.969995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.047382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2f0a-4132-4197-9199-dcd0433dc7e9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.065535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036283-4050-44c0-9074-18ec98778973 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.073037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.080640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.081240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.081525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.081806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.088023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.088023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.088023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.092978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 199/391] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.093763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.103860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.104497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.104778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.105052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.105683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.105986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.107344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.118581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 193/392] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.119344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.188323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.196944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc64df-0b9f-4fae-b9d0-43d1ba886694 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.221819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c66f6-90a9-4d5a-8cd1-4cc5f9df0eba None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.231490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.232115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.232434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.232707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.242556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.243982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.256155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.256791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.257070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.257342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.257974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:29.258076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:29.259042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:29.259886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:29.259886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:29.259886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:29.260061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.260129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 200/393] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:29.260194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.260260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.276548 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 194/394] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.277348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.306730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.361511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bc984-9655-4240-a88f-ba88ce811b2a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.373648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995a5b-800b-4ad8-a320-49c90f8d1b08 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.395078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.395700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.395982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.396253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.399037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.403697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.405180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.407364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.407994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.408274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.408582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:29.417976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:29.419385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 201/395] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:29.420280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.422200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.423639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:29.439519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:29.440633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:29.441908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:29.441908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:29.441908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:29.441908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 195/396] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:29.441908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.526554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a8bfc-8523-40f9-ae6d-3132c26cde54 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.527983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.541167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d625cb4-8125-4ed1-9457-1841126f5c2a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.561701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.562316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.562585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.562856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.569887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.571314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.574974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.575584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.575865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.576142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.576816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.577120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.578472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:29.583461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:29.584525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:29.585411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 202/397] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:29.585877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.591235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 196/398] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.591966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.631944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.687140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8060baf-bc1d-46d3-97c4-4106e19cafe8 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.690374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398130e-90ee-4951-ad13-e9fed1951af7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.720625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.721248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.721528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.721830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.724181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.724870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.725151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.725425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.726146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.726452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.727901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.728567 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.730001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:29.741550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:29.742552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:29.743397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 203/399] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:29.743855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.747210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 197/400] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.748020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.778222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.843968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:29.849594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf8780-8ec9-4214-98a3-b58e505d00fc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.850572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0617-5503-4575-843b-5832db6a63a2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:29.883401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.883768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:29.884005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.884286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.884408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:29.884588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.884699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:29.884915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:29.885273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.885544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:29.885641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.885843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:29.887002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.887181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:29.898959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 204/401] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.899722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.905071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 198/402] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:29.905873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:29.984357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:30.000359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8afad-acda-432b-b87e-8763397905b7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.001476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754a74a-e32f-41d3-8308-c64d21465c4b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.034003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.034539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.034818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.035094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.035986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.036372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:30.036627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.036735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.036910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.037258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.037899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.038121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.040136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.049916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 199/403] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:30.054765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.071382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:30.141600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 205/404] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:29 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:30.141600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.152128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d6b27-d35a-4fdd-8785-6fec5d134886 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.189911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.190583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.190865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.191139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.203150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.204735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:30.221485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:30.222485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:30.223359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:30.223359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:30.223359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:30.223359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 200/405] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:30.223575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.266480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c625c-a73c-49c3-af0e-34dd22bd49e4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.303575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.304134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.304436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.304712 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.312640 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:30.312983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.314459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.317813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:30.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:30.330051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 206/406] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:30.331288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.351284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3408306-3e6c-4e27-9ed2-0ad8d355b437 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.387919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.388695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.388883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.389381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/921d9ef4dcf94699b5708747fbe0146f/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.405854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=921d9ef4dcf94699b5708747fbe0146f, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.407308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.438111 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10c4a4-e693-42b9-92d2-1d99ea1c9705 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.467590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 201/407] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:30 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/921d9ef4dcf94699b5708747fbe0146f/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:30.468862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.485585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.486584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.487033 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.487597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/3ec4a4200e034887a5e119c109dea1f4/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.507034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=3ec4a4200e034887a5e119c109dea1f4, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.508942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.578288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 207/408] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:30 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/3ec4a4200e034887a5e119c109dea1f4/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:30.579730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.598206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7564b-11fa-49ae-b504-c208e5c8cddc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.624148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:30.648465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.649594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.650055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.650539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.651902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:30.652467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.654406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.669175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 202/409] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:30.677213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.707475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:30.798332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89fa09-dc4b-4f46-be11-5e233a4fe4ba None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.822723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49489d12-f1cb-45c2-ac78-bde620a0c70c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:30.854884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.855864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.856599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.857040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.857926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:30.858838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.861022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.867902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:30.868585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:30.868870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:30.869144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:30.876565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:30.878035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:30.884769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 208/410] 10.222.0.13 () {56 vars in 1139 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:30.893485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:30.894970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:30.895999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:30.897104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:30.903888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 203/411] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:30.905938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:30.956203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:31.023912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6cc1-e48f-4ec5-860e-c34349175928 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:31.062586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:31.063445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:31.063903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:31.064326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:31.065177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:31.065648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:31.067267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:31.080659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 204/412] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:31.087150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:31.143842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723a9ba-6fb2-43ad-85d1-49a3ee779663 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:31.164719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:31.205131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:31.205784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:31.206063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:31.206333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:31.208882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:31.212751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49ec0f-54d7-4087-a4a1-0e1d17cce852 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:31.238479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:31.239949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:31.250068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:31.250737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:31.251023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:31.251300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/531145399f98493daef67bc1aa803a93/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:31.268266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=531145399f98493daef67bc1aa803a93, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:31.270313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:31.286215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:31.288283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:31.289366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:31.289366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:31.289366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:31.289366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 209/413] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:31.297325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:31.383472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 205/414] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:31 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/531145399f98493daef67bc1aa803a93/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:31.421671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff155-396b-42f6-b991-2b413fb8ab6a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:31.464172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:31.464870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:31.465114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:31.465390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:31.466065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:31.466372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:31.467803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:31.482313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 210/415] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:31.487793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:31.629932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9736d-3d8e-455b-abc3-a581704e41a7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:31.673469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:31.673871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:31.674159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:31.674436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:31.683593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:31.685126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:31.698169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:31.699234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:31.700373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 206/416] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:31.705193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:31.730377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:31.811610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715b194-b6b6-4872-bd0e-dd851ccd6c7a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:31.847379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:31.848195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:31.848617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:31.848988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:31.849774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:31.850179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:31.851725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1fbf6-e6c9-4878-b2e8-3769ef605dac None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:31.869798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 211/417] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:31.875715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:31.892964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:31.991880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ca005-7a93-47fc-9520-bfe6bec38821 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:32.035565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebbb3-689f-446d-85d8-df369a2ae0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:32.036228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebbb3-689f-446d-85d8-df369a2ae0aa None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:32.036538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebbb3-689f-446d-85d8-df369a2ae0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:32.036819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebbb3-689f-446d-85d8-df369a2ae0aa None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/454ff45f1a974b3c9c46bd066d4e7313/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:32.051921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ebbb3-689f-446d-85d8-df369a2ae0aa None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=454ff45f1a974b3c9c46bd066d4e7313, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:32.053444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ebbb3-689f-446d-85d8-df369a2ae0aa None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:32.125857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 207/418] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:31 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/454ff45f1a974b3c9c46bd066d4e7313/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:32.626698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeee0-b9cd-49cb-b4eb-3767c8bac672 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:32.627211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeee0-b9cd-49cb-b4eb-3767c8bac672 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:32.627319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeee0-b9cd-49cb-b4eb-3767c8bac672 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:32.629374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 212/419] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:32.634647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4b3b9-ccf2-4fbf-95b5-82b0d012fed6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:32.635043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4b3b9-ccf2-4fbf-95b5-82b0d012fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:32.635207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4b3b9-ccf2-4fbf-95b5-82b0d012fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:32.663991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ecc4b3b9-ccf2-4fbf-95b5-82b0d012fed6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:32.665258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ecc4b3b9-ccf2-4fbf-95b5-82b0d012fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:32.734900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:32.755508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 208/420] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:33.136165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddeee0-b9cd-49cb-b4eb-3767c8bac672 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:33.247978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:33.274109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddeee0-b9cd-49cb-b4eb-3767c8bac672 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:33.322537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea550a3-2cea-474e-b8a7-5975d6b01d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:33.323286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea550a3-2cea-474e-b8a7-5975d6b01d59 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.323467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea550a3-2cea-474e-b8a7-5975d6b01d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.323725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea550a3-2cea-474e-b8a7-5975d6b01d59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.336118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f82c0-274c-4918-a8c6-8ed8f3a63ae5 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.336416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f82c0-274c-4918-a8c6-8ed8f3a63ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.336699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f82c0-274c-4918-a8c6-8ed8f3a63ae5 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.337161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea550a3-2cea-474e-b8a7-5975d6b01d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:33.338282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 209/421] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8ea550a3-2cea-474e-b8a7-5975d6b01d59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:33.342151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:33.343105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:33.344311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 213/422] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:33.353534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f82c0-274c-4918-a8c6-8ed8f3a63ae5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:33.354073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf0ab1-7655-4ce1-ab8a-2b6483962c0d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.354364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf0ab1-7655-4ce1-ab8a-2b6483962c0d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.354644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf0ab1-7655-4ce1-ab8a-2b6483962c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.394161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1abf0ab1-7655-4ce1-ab8a-2b6483962c0d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:33.395332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1abf0ab1-7655-4ce1-ab8a-2b6483962c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:33.512106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 214/423] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:33.514234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fa692-8644-487a-ab4d-cd95ee8ee8c7 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.514730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fa692-8644-487a-ab4d-cd95ee8ee8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.515265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fa692-8644-487a-ab4d-cd95ee8ee8c7 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.517005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 215/424] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:33.525723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.526289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.526767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.536728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f82c0-274c-4918-a8c6-8ed8f3a63ae5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:33.563597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:33.567108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:33.606485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:33.607096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.607376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.610369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.611064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:33.611376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:33.612776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:33.621701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 210/425] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:33.627268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:33.715795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:33.726499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 216/426] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:33.743491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:33.790360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:33.822562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0090-854c-40e8-9852-65ef8da4ffdb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:33.889958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:33.890604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.891366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.891661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.906912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:33.908852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7eaec495-a9a7-4140-9774-56c8a9fc75d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:33.927355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:33.928247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:33.929723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:33.929723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:33.929723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:33.929723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 211/427] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:33.929939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030278-e707-4055-8a6b-47f67ba4e2c9 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.930227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030278-e707-4055-8a6b-47f67ba4e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.930544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030278-e707-4055-8a6b-47f67ba4e2c9 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:33.931941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 212/428] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:33.934409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030278-e707-4055-8a6b-47f67ba4e2c9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:33.951702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d8b6f-ad44-4663-a07a-9fcacc7d337a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:33.989575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001e84e-20b1-4394-a813-2cea85bc82c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:33.990292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001e84e-20b1-4394-a813-2cea85bc82c8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:33.990647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001e84e-20b1-4394-a813-2cea85bc82c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:33.991257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001e84e-20b1-4394-a813-2cea85bc82c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.002459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001e84e-20b1-4394-a813-2cea85bc82c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7001e84e-20b1-4394-a813-2cea85bc82c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:34.008181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:34.009160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:34.009975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 217/429] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:34.011515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.011913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.012362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.032614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:34.033955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:34.044630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030278-e707-4055-8a6b-47f67ba4e2c9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.046450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.083196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.083809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.084088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.084361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.085031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:34.085334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.086716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.095569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.100584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 213/430] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:34.100584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.112946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 218/431] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:34.114646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.206095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe376c80-e4fa-42c4-baf9-aaf4ebb1b89d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.243411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.244485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.244942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.245489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.246331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:34.246823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.247364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfad55-ac0e-456c-8641-9cd3ed85d449 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.248660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.258207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 214/432] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:34.259528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.286086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.294757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.295401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.299618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.299618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.310522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:34.317728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:34.318608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:34.319401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 219/433] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:34.320058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.375736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.390102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49794e3c-80f3-4a73-b219-d97eb49cc6cd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.430838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a09d0-8f2d-4b61-bb8b-03c81d52b496 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.434595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.435212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.435496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.435769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.445800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.447400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:34.459030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:34.459926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 215/434] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:34.461311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.472580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.473675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.473957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.474229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.485540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.487301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:34.501842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:34.502717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:34.509479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:34.509479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:34.509479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:34.509479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 220/435] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:34.509479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.556156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.573064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efdf3f-8450-4657-b37b-67b0ec53c713 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.610072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.610625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.610903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.611127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.611229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.611874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:34.612182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.615583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.616495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438f495-5544-4b10-b179-8dfb91d39f61 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.629725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 216/436] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:34.629725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.655043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.655677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.655957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.656231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.667224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:34.672362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:34.673384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 221/437] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:34.677180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.746893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e01ff-9da1-439d-a662-33c8b445171a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.779490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.779682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da881dc-6236-4cb6-bf42-fb4af23704bb None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.780096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.780360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.780666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.781385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:34.781681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.783114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.799942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 217/438] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:34.801333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.808177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.813266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.814760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.814760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.814760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.815095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:34.815319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.816724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.829177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 222/439] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:34.829968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.852987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:34.902779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29227f-584f-4ade-a0f0-fd34e9caf04a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.929345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e393ae8-ba37-4d1f-a1ef-8565c5937307 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:34.935999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.936658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.936936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.937212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.947511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.948998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.962195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:34.962792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.963073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-595084d1-76a0-4d7c-b45a-2cd0a3c75039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:34.963179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:34.964180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:34.965176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:34.965176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:34.965176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:34.965341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.965341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:34.965468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 218/440] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:34.965696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30366-1387-4b8f-bd23-b40d0aa94a83 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:34.965975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30366-1387-4b8f-bd23-b40d0aa94a83 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:34.966249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b30366-1387-4b8f-bd23-b40d0aa94a83 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:34.967468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 219/441] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:34.968156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30366-1387-4b8f-bd23-b40d0aa94a83 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:34.968594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:34.970147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:34.978963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 223/442] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:34.979805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.029800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.059155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.073489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b30366-1387-4b8f-bd23-b40d0aa94a83 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.076060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae469f3-d5c4-4690-b4f2-5d6a37dbe932 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.107309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.107928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.108206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.108506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.109523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.110147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.110431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.110703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.117974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.118329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.119388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.119749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:35.130324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:35.131337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:35.132236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 224/443] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:35.132827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-afd23640-6cbe-41ad-a874-d684ddf2b1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:35.133925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:35.134770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:35.136091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:35.136091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:35.136091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:35.136091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 220/444] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:35.136614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.136892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.137163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.154901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:35.156068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:35.239225 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 221/445] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:35.239418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346bc40-fccc-480e-9cec-bb3831ee8569 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.240048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.284556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.285512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.286358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.286643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.287231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.287562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:35.287871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.289277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.305287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 225/446] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:35.305287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.305287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.355130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b80c6-9808-4436-b341-75e951822d4d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.389405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.390124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.390404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.390678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.401487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.402949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.412969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e07ba-283a-4eac-926e-4b13645cb365 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:35.418063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:35.418937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:35.419796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:35.419796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:35.419796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:35.420589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 222/447] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:35.421398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.452565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.453448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.453911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.454186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.455011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:35.455323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.456808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.479109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 226/448] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:35.479109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.516520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.526738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71513b-cf7e-4192-a348-6429b40eca88 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.539340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.560242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.560882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.561241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.561513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.562151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:35.562451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.563813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.583939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 223/449] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:35.583939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.584209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f219bcb-7880-445b-93b7-6d82c8617444 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.617283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.617902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.618180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.618449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.626740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.629128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:35.640790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:35.641777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 227/450] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:35.642663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.684113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce813a-6930-4e5b-9c07-438f462486dd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.717498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.718100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.718382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.718652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.719285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:35.719588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.721000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.732686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 224/451] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:35.733886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.745442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced6653-bfc8-425d-9f4b-ae93ccb401e7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.746447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.765787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.779373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.781772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.781772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.781772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.832064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c431c57-b96f-43b5-9e57-813342a1c94d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:35.846559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:35.848032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:35.864754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:35.865380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:35.865661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:35.865933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:35.875611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:35.880939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:35.881816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:35.882615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 225/452] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:35.883263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.945844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 228/453] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:35.946938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:35.954191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.966686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:35.984069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ac9b3-4758-4257-95ad-1df5b421c75a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.017690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.018415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.018696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.018976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.025445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.026887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:36.037690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:36.038495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:36.039365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 226/454] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:36.039858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.047420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf8786-f39f-4115-a534-f961748aa20c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.081467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.082169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.082389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.082662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.083383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:36.083684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.085174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.102389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 229/455] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Oct 14 02:49:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:36.103163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.137096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da97506-dd3c-43e4-9a93-8559a93f9ab5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.165263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.170656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.171280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.171567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.171838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.179721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.180212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.181269 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:36.192131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:36.193045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 227/456] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:36.194141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.205730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb7b35-ae55-4fc5-8204-4ab7391bf857 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.242073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.242681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.242960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.243435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.243894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:36.244197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.245598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.253165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 230/457] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:36.253991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.295957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5d12e-a675-4cdd-a752-0675c0ad7151 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.328145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.328798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.329077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.329353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.339777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.341196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.349459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e95db-bb52-483b-9b74-c8641d6dbf75 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:36.355197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:36.356256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:36.357165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:36.357165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:36.357165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:36.357165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 228/458] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:36.357463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.386994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.387605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.387892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.388164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.389153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:36.389460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.390877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.399050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.399759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.402828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 231/459] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:36.403610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.454109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a5e3-fc34-4006-ba0d-dabc324831f1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.486652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.487243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.487519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.487819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.500747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219f3d-d0b7-4977-a239-4b6e7b059d2f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.534079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.534669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.535515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.535788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.536573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:36.536880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.538319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.554720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.555203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 232/460] 10.222.0.13 () {56 vars in 1137 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:36.556001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.556180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.598959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.612009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.653510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e8698-569d-4fb1-8a84-e5c905eeb74c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.654591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 229/461] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:36.655550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.687823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.688474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.688750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.689020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.698616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.700045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:36.714674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:36.715741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:36.716827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:36.716827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:36.716827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:36.716827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 233/462] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:36.717087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.755880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdc27f-2db8-4135-8c2a-0a027d2f846c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.790025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.790627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.790909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.791195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.791836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:36.792142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.793557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.804760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 230/463] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:36.805362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.807761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.818193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ce306-e5c8-483c-9939-7db0fd1b6ff9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.828631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:36.852601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.853181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.853458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.853729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/972095d3e6cb4472b1c465a780138806/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:36.868685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=972095d3e6cb4472b1c465a780138806, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:36.870122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:36.902779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64bd33-e562-4b0f-a96d-37ee890afd16 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:36.929830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 234/464] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:36 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/972095d3e6cb4472b1c465a780138806/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:36.930642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:36.942919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:36.943895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:36.944352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:36.944725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.025103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.026927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.029254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.039511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c143-c12e-4052-ac62-91fc46427aea None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.080749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.081488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.082455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.082836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.095254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.096747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:37.113692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:37.114835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:37.115847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:37.115847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:37.115847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:37.115847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 235/465] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:37.115847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.134015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.137556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 231/466] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:37.140423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.227604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082daaf-2905-45ca-b937-47180b2c7b24 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.250196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7fa09-a461-408e-89d1-ad89062cd7f1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.251717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.264721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.265701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.266167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.266444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.267095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:37.267396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.268827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.281252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 236/467] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:37.282149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.289035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.289669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.289944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.290209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.297510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.298956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:37.311399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:37.312221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:37.313123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 232/468] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:37.313586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.366791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.399072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024e0c6-2642-4274-8387-43b33fd969bf None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.415304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d598569-daa3-47ba-bce1-cf1fff522481 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.435102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.435711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.435990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.436263 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.436954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:37.437239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.438603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.450698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 237/469] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:37.451513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.456498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.457146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.457447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.457683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.468140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.469625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:37.483892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:37.485013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:37.486035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:37.486035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:37.486035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:37.490039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 233/470] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:37.490750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.507015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.570527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456288-f8e6-40da-8727-c75e58b8eef4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.592745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f90a9-8780-4205-8862-c5cd7a9edbaf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.605099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.610519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.611153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.611481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.611757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.620426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.621819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.630556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.631391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.631864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.632326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:37.632914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:37.633771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:37.634657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 238/471] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:37.635214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.636067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:37.636578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.638193 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.650608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 234/472] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:37.653905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.732362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.756126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64451302-5b97-442b-aa2d-f70b98baa3ff None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.757580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2691a9-d3c3-4469-a691-efbab07c6f9b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.791780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.791995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.792579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.792681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.792996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.793085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.793372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.793474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.794139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:37.794514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.795982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.802149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.803757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.814264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 235/473] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:37.814264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:37.820279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:37.821678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 239/474] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:37.827598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.880793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.922759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa7be8-db2f-42d5-8d96-807ed6003ebd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.930442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8c52d-005f-4230-94ef-c0668d904853 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:37.961216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.961816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.962100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.962380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.963111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:37.963411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.964882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.966400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:37.966564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:37.967002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:37.967290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:37.967581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:37.968282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=921d9ef4dcf94699b5708747fbe0146f) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:37.968622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:37.970036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:37.980549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 240/475] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/role_assignments?user.id=921d9ef4dcf94699b5708747fbe0146f&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:37.981523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:37.988713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 236/476] 10.222.0.13 () {56 vars in 1139 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:37.989897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.103268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb92a8-53c1-4a45-8860-cd5d1a2171f0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.124659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:38.135254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3882d7-9871-4e06-9ebc-f804e1238196 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.153288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.155487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.155760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.156034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.166460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.168894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:38.183318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:38.184544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 241/477] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:38.185418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.188879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.189495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.189776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.190048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.190749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:38.191086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.192638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.209475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 237/478] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:38.210557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.282081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:38.321370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6f831-fbad-43b5-9413-7c7fb8abcb58 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.336823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425729f-f789-4c3f-89a6-fc7b0f38929e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.367907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.369049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.369333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.369607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.375249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.376100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.376603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.377180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.378067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:38.379531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.381562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.398645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 238/479] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:38.400164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.418027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:38.442589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.444357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.527280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fd274-dfe3-4c26-be49-62c153db0bd1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.544237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:38.556158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 242/480] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:38.557516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.569904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.570956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.571472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.572065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.574163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=3ec4a4200e034887a5e119c109dea1f4) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:38.574650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.576344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.585807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 239/481] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:38 2022] GET /identity/v3/role_assignments?user.id=3ec4a4200e034887a5e119c109dea1f4&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:38.586914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.725424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:38.744270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6e33b-baac-4609-a016-f437f930f68f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.774873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32b2a-88db-415c-9c8b-90e22e603e98 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:38.795220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.795860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.796137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.796421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.811899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.813804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.824323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:38.824885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:38.825170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:38.825442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:38.826172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=531145399f98493daef67bc1aa803a93) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:38.826482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:38.827922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:38.832642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:38.833619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:38.834462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:38.834462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:38.834462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:38.835181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 243/482] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:38 2022] GET /identity/v3/role_assignments?user.id=531145399f98493daef67bc1aa803a93&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:38.836683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 240/483] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:38.843049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:38.961877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515a2-685e-429e-bc55-54fe425d6bcc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:39.001870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:39.002508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.002793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.003070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.004427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:39.004736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:39.006192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b2cfc-a95b-43fe-963b-4f253c556644 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:39.017215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:39.021055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 244/484] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:39.026785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:39.075315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:39.115580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cf43-0e61-4fdf-8c7a-5e95948be49e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.115900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cf43-0e61-4fdf-8c7a-5e95948be49e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.116144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7cf43-0e61-4fdf-8c7a-5e95948be49e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.117891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 245/485] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:39.124414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.124767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.124982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.146354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:39.147553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:39.155560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3137892-7bba-4a98-a50b-27a1d00d1498 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:39.206617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:39.207260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.207539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.207810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.215254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:39.220761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:39.233130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:39.233989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:39.234837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 241/486] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:39.242118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 246/487] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:39.245335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:39.342484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:39.356913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df43b1-7a21-4d94-ae5a-31ea633427b8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:39.405994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:39.406611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.406894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.407199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.407869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:39.408174 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:39.410175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:39.427001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 242/488] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:39.433096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:39.546163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:39.602527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f380-4bf6-43e5-8fd9-32475f771108 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:39.660753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:39.672102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:39.672767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.673049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.679103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.679103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=454ff45f1a974b3c9c46bd066d4e7313) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:39.679103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:39.679103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:39.691124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 247/489] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:39 2022] GET /identity/v3/role_assignments?user.id=454ff45f1a974b3c9c46bd066d4e7313&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:39.738615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf947c-5b24-499f-bd3c-921fcd93a9aa None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:39.793406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:39.794065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.794356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.794630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.806958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:39.812275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:39.813221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:39.813997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 243/490] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:39.822685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:39.943350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60b0d7-ec6f-42b7-b8e1-92a23bcade25 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:39.982376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:39.982996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:39.983279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:39.983558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:39.984231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:39.984622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:39.986191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:39.996764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 248/491] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:40.005065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:40.021698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:40.137701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae549d2b-8784-4a71-b3fd-475d5d3d9fed None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:40.187872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:40.188543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:40.188825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:40.189100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:40.206272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:40.208515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:40.224979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:40.226066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:40.226919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:40.226919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:40.226919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:40.228412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 244/492] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:40.237460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:40.333500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:40.399080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aa9af-218c-45da-95c7-fcdddf6c444c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:40.458931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:40.459538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:40.459820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:40.460086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:40.460759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:40.461062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:40.462437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98676bd-8ac9-41b8-9402-04967579b6bc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:40.479614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 249/493] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:40.489455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:40.541543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c1921-494a-414e-9dc3-b9bc9aac3551 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:40.541996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c1921-494a-414e-9dc3-b9bc9aac3551 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:40.542376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c1921-494a-414e-9dc3-b9bc9aac3551 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:40.544054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 250/494] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:40.549000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:40.549543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:40.550783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:40.586635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:40.586829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:40.587861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:40.670915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d58bb-6c5f-4436-b8f9-6582492906b9 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:40.698692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 251/495] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:40.734206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:40.734843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:40.735123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:40.735397 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:40.744659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:40.746111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:40.769799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:40.770856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:40.771766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 245/496] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:40.776675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:40.832762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:40.898550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95982-756a-4b76-84d9-ad89693d909a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:40.943583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:40.944327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:40.944506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:40.944652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:40.945387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:40.945694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:40.947124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:40.965676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 252/497] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Oct 14 02:49:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:40.970855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:40.995314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:41.131811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7fd4d-632c-4283-8dd4-139c01b59fbd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:41.134194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:41.168088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:41.169037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.169508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.170056 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.174306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dfab8-3cc5-4864-890b-3a2f3c2008c2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:41.181553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:41.183132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:41.199376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:41.200330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:41.201216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:41.201216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:41.201216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:41.201216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 253/498] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:41.206293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:41.224569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:41.257326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74495266-f714-46ea-8bae-6114c6d20e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:41.257956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495266-f714-46ea-8bae-6114c6d20e98 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.258235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495266-f714-46ea-8bae-6114c6d20e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.258505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495266-f714-46ea-8bae-6114c6d20e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.330337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d3ad-0420-4e32-8aa7-078090487b18 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:41.369812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:41.370442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.370724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.371004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.371675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:41.372044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:41.373568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:41.389595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 254/499] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:41.395126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:41.419926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74495266-f714-46ea-8bae-6114c6d20e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:41.421440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74495266-f714-46ea-8bae-6114c6d20e98 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:41.436080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:41.530169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79a67f-a5ee-4974-8446-6c6b0f39d8dd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:41.562221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 246/500] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 14 02:49:41.563841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62011-8b0e-434a-8bcb-ed0f900baf3e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.564325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62011-8b0e-434a-8bcb-ed0f900baf3e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.564815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62011-8b0e-434a-8bcb-ed0f900baf3e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.566579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 247/501] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:41.567492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62011-8b0e-434a-8bcb-ed0f900baf3e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:41.572753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aab5fd-0c50-4f9b-bc71-3dc048a9fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:41.573454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aab5fd-0c50-4f9b-bc71-3dc048a9fa6e None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.573741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aab5fd-0c50-4f9b-bc71-3dc048a9fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.574016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aab5fd-0c50-4f9b-bc71-3dc048a9fa6e None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.574698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aab5fd-0c50-4f9b-bc71-3dc048a9fa6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:41.576655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aab5fd-0c50-4f9b-bc71-3dc048a9fa6e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:41.593554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:41.660515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 255/502] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:49:41 2022] POST /identity/v3/users => generated 254 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:41.662402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21ba2e-3d95-4f2a-bcc9-b1e364b82ce6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.662941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21ba2e-3d95-4f2a-bcc9-b1e364b82ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.663442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21ba2e-3d95-4f2a-bcc9-b1e364b82ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.703888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-dc21ba2e-3d95-4f2a-bcc9-b1e364b82ce6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:41.705536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc21ba2e-3d95-4f2a-bcc9-b1e364b82ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:41.705857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62011-8b0e-434a-8bcb-ed0f900baf3e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:41.749631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:41.750280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.750560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.750831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.763188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:41.765100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ffb749af-86c1-4603-a0f6-8b4839f6e55a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:41.783116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:41.784203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:41.785734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:41.785734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:41.785734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:41.788833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 248/503] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:41.790340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf65917-323f-4f42-87b2-471e0b3adc27 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.790956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf65917-323f-4f42-87b2-471e0b3adc27 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.791067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf65917-323f-4f42-87b2-471e0b3adc27 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.792414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 249/504] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:41.796128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 256/505] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:41.799405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf65917-323f-4f42-87b2-471e0b3adc27 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:41.800187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.800728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.801237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.808528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:41.827085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:41.828757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:41.917930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 257/506] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:41.923651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:41.959686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf65917-323f-4f42-87b2-471e0b3adc27 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:41.997169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:41.997778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:41.998061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:41.998337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:41.999038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:41.999345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.000859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.014985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 250/507] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:42.022658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.105246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.142179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468b346-35b9-42e9-a1b0-4c53cf5c4602 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.208009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:42.212673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.213326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.213616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.213901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.223746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591a53-7b30-402e-8210-bbeb4f5c6f8a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.233495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.234961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.257012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:42.262545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:42.262771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:42.265930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:42.266827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:42.267357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.267357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.267357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.267633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 258/508] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:42.270379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.279598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:42.287273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:42.288222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:42.289084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:42.291726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 251/509] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:42.295151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.418886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08b1e7-0c21-4264-aead-a578ffb520a7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.426896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c2ef0-5068-4aa2-8387-c9193178060e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.463578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.464191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.464499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.464777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.465915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:42.466274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.468097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.475227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.476781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.477066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.477340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.477946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.479319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.485797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 259/510] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:42.486906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:42.494431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:42.495439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:42.496282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:42.502893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 252/511] 10.222.0.13 () {56 vars in 1129 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:42.502893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.549554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:42.565880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:42.602834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2205-ff19-46b1-b79f-6b2a525962ac None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.613019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cca9d-763c-4dd7-81a2-354a9fae757c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.639520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.640603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.641081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.641547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.642502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:42.643072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.645181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7040-f242-4690-9a21-49b836bfb472 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.647920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.648557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.648844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.649118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.649847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=972095d3e6cb4472b1c465a780138806) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:42.650162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.651639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.662462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 253/512] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/role_assignments?user.id=972095d3e6cb4472b1c465a780138806&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:42.662462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.662743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 260/513] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:42.662743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72716646-dddd-493c-973b-f9ada363cba3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.662743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72716646-dddd-493c-973b-f9ada363cba3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.662743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72716646-dddd-493c-973b-f9ada363cba3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.664009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 261/514] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:42.664801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72716646-dddd-493c-973b-f9ada363cba3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.785171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b95ec-6567-4a61-b957-ce2a6f44dc48 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.816178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:42.816376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72716646-dddd-493c-973b-f9ada363cba3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:42.832719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:42.836712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.837895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.838382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.838855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.839718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:42.840687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.842547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162c1a-bbd6-4abd-8bea-fe9d63bf0c1d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.849773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 254/515] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:42.851563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.852046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.852502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.858578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:42.859220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:42.859505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:42.859780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:42.872246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:42.872616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:42.873484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:42.874109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:42.890250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:42.891226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:42.892110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:42.892110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:42.892110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:42.892110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 262/516] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:42.892332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:42.978407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 255/517] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:42.979064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.035698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56157f7-34db-4203-b118-286b97a23de7 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.072217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.073206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.073759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.074238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.075163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:43.075672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.077289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.088713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 263/518] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:43.172950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a9126-0035-4a12-b247-d23fdc22532a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.199935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:43.229667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.230298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.230510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.230789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.231506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:43.231847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.233344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.252139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 256/519] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:43.258072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.304044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.320765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:43.437033 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d34d3-59d6-4ff6-b7b8-971b4a99354d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.469495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157a356-9a0f-4450-b457-a0870e03db34 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.512229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.513189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.513717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.513998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] PATH_INFO: `/v3/services/network` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.514585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.515950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:43.531261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:43.532297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:43.533168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 257/520] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:43 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:43.539652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.553687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.554464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.554738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.555011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.581261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.582722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.583387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:43.614179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:43.615204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:43.616147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 264/521] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Oct 14 02:49:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:43.629106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.665641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6919d-801a-4cb2-97f7-5f25a446f2ca None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.741172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.742091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.742371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.742639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.743296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] RBAC: Adding query filter params (name=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:43.743600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.745043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.756714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 258/522] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:49:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:43.757618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.768890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:43.774716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59759fe-e9dd-422c-b69a-c354ab5f1490 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.812267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.813115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.813450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.813840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.814580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:43.814892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.816558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.848266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 265/523] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Oct 14 02:49:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:43.853913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:43.914583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f97c7-9892-4d3b-b73c-3cb51f643408 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:43.916987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:43.982481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:43.983096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:43.983372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:43.983642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:43.984273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] RBAC: Adding query filter params (type=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:43.984607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:43.985973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:43.998376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 259/524] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:49:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:44.048798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a89af-e53d-41e8-8b6e-a895db56f6ce None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:44.107221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:44.107902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.108185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.108490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.126885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:44.128528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:44.144472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-649960f7-f0ec-4379-bd37-f02d372bb40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:44.153453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:44.155621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:44.157676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:44.157676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:44.157676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:44.157676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 266/525] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:44.164472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:44.252354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb996ed-b0b1-4b63-a15d-cc978d4c96ef None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.252715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb996ed-b0b1-4b63-a15d-cc978d4c96ef None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.252960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb996ed-b0b1-4b63-a15d-cc978d4c96ef None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.254538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 267/526] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:44.262622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.262622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.262622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.281064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8be0-2606-433e-a91d-e3c3a382468e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:44.285350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:44.286763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:44.327544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:44.328444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.328444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.328771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.329423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:44.329723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:44.331746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:44.354743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 260/527] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:44.360175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:44.392266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 268/528] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 14 02:49:44.408770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:44.493179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1777d-86d8-4713-94ac-728aaaf933b3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:44.529483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:44.530116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.530387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.530653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.544418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:44.545937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:44.559738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:44.560772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:44.561655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 261/529] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:44.567407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:44.686235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed554e-efdc-4e7b-b258-f2cd67a4dda9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:44.715323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:44.740742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:44.747928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:44.748623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.748899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.749164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.749858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:44.750158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:44.753479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:44.770756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 269/530] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:44.776461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:44.877630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:44.913639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aee823-b3b2-4718-be14-200ef412ce8e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:44.930483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540971-792d-4a35-a563-1a1203d95057 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:44.964358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738503-dd88-4672-8a46-542d7d1b26f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:44.965414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738503-dd88-4672-8a46-542d7d1b26f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.965902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738503-dd88-4672-8a46-542d7d1b26f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.966380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738503-dd88-4672-8a46-542d7d1b26f9 None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/3ec4a4200e034887a5e119c109dea1f4/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:44.972186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738503-dd88-4672-8a46-542d7d1b26f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=3ec4a4200e034887a5e119c109dea1f4, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:44.973921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738503-dd88-4672-8a46-542d7d1b26f9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:44.993175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:44.994169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:44.994656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:44.995240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.007178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:45.012919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:45.014646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:45.015496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:45.017743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 262/531] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:45.024740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:45.038929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 270/532] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:44 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/3ec4a4200e034887a5e119c109dea1f4/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:49:45.157280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ddbd9-c4cb-4078-8fc3-08b5f9085264 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:45.201305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:45.201843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:45.202121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:45.202388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.203117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:45.203427 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:45.204871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:45.208040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f030-b255-485f-91b6-a6b1c8e865c9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:45.208546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f030-b255-485f-91b6-a6b1c8e865c9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:45.208731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639f030-b255-485f-91b6-a6b1c8e865c9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.210340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 271/533] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:45.214562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 263/534] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:45.215764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:45.216053 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:45.216333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.220144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:45.240152 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:45.241183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:45.242618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:45.322582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:45.344542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 272/535] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:45.373154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3588557-db73-4372-9f5b-b39f50e42114 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:45.413968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:45.414669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:45.415011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:45.415278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.428305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:45.429842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:45.451480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:45.452441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:45.453336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:45.453336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:45.453336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:45.456800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 264/536] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:45.462099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:45.600822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c9782-a4d6-4778-a317-1a8d4cf0313d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:45.640218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:45.640959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:45.641452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:45.641736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.642397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:45.642704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:45.644678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:45.657141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 273/537] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:45.662796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:45.754726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:45.769932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:45.811832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b576425-92e0-4d72-9374-a960ec9347da None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:45.854929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:45.887243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:45.887880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:45.888166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:45.888718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:45.901865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:45.903323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:45.927533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:45.928540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:49:45.929475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:45.931214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 265/538] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:49:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:45.934839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:45.969741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b77dd1-ce89-46b3-852a-d9c49d550014 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.004877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581f377-7cf0-4b9e-abac-f24d5458367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.005430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581f377-7cf0-4b9e-abac-f24d5458367d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.005709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581f377-7cf0-4b9e-abac-f24d5458367d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.005982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581f377-7cf0-4b9e-abac-f24d5458367d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.016868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581f377-7cf0-4b9e-abac-f24d5458367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3581f377-7cf0-4b9e-abac-f24d5458367d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:46.024812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:46.025761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 274/539] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:46.026604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883d55-a186-4cc8-b62d-f4faebbb8dd2 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.027342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883d55-a186-4cc8-b62d-f4faebbb8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.027342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883d55-a186-4cc8-b62d-f4faebbb8dd2 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.032505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 275/540] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:46.032505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883d55-a186-4cc8-b62d-f4faebbb8dd2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.067699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0b733-d7ec-44da-b122-b0066bbc3007 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.090365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:46.104139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.104843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.105123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.105395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.106166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:46.106465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.107938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceaad64-3101-43a0-af2e-a5a2c8fcd89c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.131530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 266/541] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Oct 14 02:49:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:46.132862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.133147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.133416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.148935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:46.152087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:46.153423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:46.154075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883d55-a186-4cc8-b62d-f4faebbb8dd2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.198067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.199072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.199418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.199761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.200615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:46.200986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.202444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.212053 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 276/542] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:46.212945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.255519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 267/543] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:46.263791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.358791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70272e93-a888-4549-bf42-f4faa7b1caf5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.415525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.416168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.416479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.416756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.437841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.439300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.446606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241bfa5-0c1a-49bb-899b-732bbfd9b651 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:46.467976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:46.468992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:46.469863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:46.469863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:46.469863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:46.470033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:46.470628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 277/544] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:46.479577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.512353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:46.517881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.519570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.520047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.520674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.537596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.540162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:46.568261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:46.569313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:46.570219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:46.570219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:46.570219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:46.570691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 268/545] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:46.577256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.660264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ebf4f-0948-4907-8979-49002e6dbbca None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.703872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.704883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.705399 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.706080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.707227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:46.707746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.711500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.723419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9df55-07a4-4daa-8e83-9d07234852c0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.726742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 278/546] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:46.727728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.759201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.759866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.760108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.760381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.761160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:46.761335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.762759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94b126-8881-4610-aefe-d769c67fc317 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.776115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 269/547] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:46.781494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa242b5-0947-412d-96be-c3fdcb47abc4 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.781780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa242b5-0947-412d-96be-c3fdcb47abc4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.782052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa242b5-0947-412d-96be-c3fdcb47abc4 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.783440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 270/548] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:46.784498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa242b5-0947-412d-96be-c3fdcb47abc4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.807511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:46.810172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:46.834621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57e3e7-cfa4-43d9-9ac6-d1720c823f64 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.869936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4bc0-b9da-405a-9ea2-e2fe78936d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.870542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4bc0-b9da-405a-9ea2-e2fe78936d4f None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.870829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4bc0-b9da-405a-9ea2-e2fe78936d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.871105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4bc0-b9da-405a-9ea2-e2fe78936d4f None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.871754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc4bc0-b9da-405a-9ea2-e2fe78936d4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.873177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc4bc0-b9da-405a-9ea2-e2fe78936d4f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.890253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa242b5-0947-412d-96be-c3fdcb47abc4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:46.924091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:46.925423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.925712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.925993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.932805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:46.934278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:46.945404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:46.946508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:46.947675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:46.951047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 271/549] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:46.951838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:46.964031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 279/550] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:49:46 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:46.965956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:46.966380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:46.966767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:46.988891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:46.990383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:47.053297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:47.075480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bb265-b35d-4b79-b754-f48f5a10413f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.092773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 280/551] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 14 02:49:47.093702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.116940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.117961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.118476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.118929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.128927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.131286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:47.146346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:47.147370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:47.148341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:47.153170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 272/552] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:47.156874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.199927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:47.264515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a31be6-2710-4f21-878d-c89a4dbcd705 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.300154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb6d8b-bb90-4780-8234-457981fdf744 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.310454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.311736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.312186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.312646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.313901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:47.314636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.316590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.334980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 281/553] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:47.339368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.340200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.340629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.341004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.341592 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.341925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:47.342467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.344055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.356631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:47.377209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 273/554] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Oct 14 02:49:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:47.383874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.472529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43776a-fcf8-459d-a562-f8ebad54ed72 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.508284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d728-8271-43b6-b88b-d409bb0caa4f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.508879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:47.522557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40544c65-e7ff-4883-9745-653b9158f06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.523459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40544c65-e7ff-4883-9745-653b9158f06c None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.523744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40544c65-e7ff-4883-9745-653b9158f06c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.524024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40544c65-e7ff-4883-9745-653b9158f06c None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/aac2bc8b15a942438997f94fa9fdf354/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.539268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40544c65-e7ff-4883-9745-653b9158f06c None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=aac2bc8b15a942438997f94fa9fdf354, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.541016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40544c65-e7ff-4883-9745-653b9158f06c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.548380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.549103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.549452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.549818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.560257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.561781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:47.577328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:47.578475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:47.579622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:47.579622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:47.579622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:47.579622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 274/555] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:47.579622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.598195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 282/556] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:47 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/aac2bc8b15a942438997f94fa9fdf354/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:47.599727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdc77-e103-4b48-979e-418f586249e0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.600025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdc77-e103-4b48-979e-418f586249e0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.600301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fdc77-e103-4b48-979e-418f586249e0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.606026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 283/557] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:47.606026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fdc77-e103-4b48-979e-418f586249e0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.657405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:47.738504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fdc77-e103-4b48-979e-418f586249e0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.744079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29a5ff-ac01-4c8f-924d-4a9b0e696819 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:47.786424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.787040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.787319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.787587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.788230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:47.788556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.789906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715a7cd-a2ff-45f5-bcc1-8b625eb481ff None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.794018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:47.794628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.794912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.795189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.795841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:47.797737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:47.803322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 284/558] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:47.804867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:47.805360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:47.805977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:47.824211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:47.825452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:47.850025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:47.875075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 275/559] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:49:47 2022] POST /identity/v3/services => generated 240 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:47.876487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:47.945492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 285/560] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:48.063110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67829c3-8080-4d69-aa54-90e4a8b049b8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:48.078417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:48.105866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:48.106501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:48.106774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:48.107042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:48.114663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:48.116113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:48.128619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:48.130653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:48.131545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 276/561] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:48.135887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:48.266012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2ff1-96e1-4477-8cfb-6a4bb2a76354 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:48.310624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:48.311628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:48.312116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:48.312642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:48.313546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:48.314105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:48.315772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:48.318806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:48.332796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 286/562] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:48.334791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:48.357645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:48.438634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e368a9-fdd2-4f48-a696-353302c210a4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:48.473947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:48.474621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:48.474906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:48.475242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/972095d3e6cb4472b1c465a780138806/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:48.477201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=972095d3e6cb4472b1c465a780138806, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:48.478713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:48.519311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0161cf5-fa7d-4653-a3cd-8e4d1b47578e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:48.542023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 287/563] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:48 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/972095d3e6cb4472b1c465a780138806/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 02:49:48.564951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:48.565679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:48.565964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:48.566287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:48.578684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:48.585267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:48.586260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:48.587535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 277/564] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:48.594793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:48.687099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:48.711733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd0485-188d-4666-ac7f-62784a6615e9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:48.751154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:48.751923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:48.752274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:48.752619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:48.753304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:48.753614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:48.755059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:48.770663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 288/565] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:48.772341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:48.810611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:48.896549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8e5b5-4983-4bf8-803e-c0135dcc86bf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:48.943093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:48.944105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:48.944641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:48.945120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:48.960417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:48.962298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:48.982916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:48.983889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:48.984822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:48.984822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:48.984822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:48.986620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 278/566] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:48.992495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:49.143180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c251e-9396-44b1-adb3-1ceeaa3a85b5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:49.191686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:49.192220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:49.192531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:49.192854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:49.193502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:49.193808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:49.195175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:49.206857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:49.211997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 289/567] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:49.217579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:49.333535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:49.352423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508ea2c-b5fb-4feb-880f-53590a5ec5e5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:49.397331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:49.398321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:49.398891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:49.399372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:49.410293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:49.412042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:49.424075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:49.425688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:49:49.426667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:49.429223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 279/568] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Oct 14 02:49:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:49.436494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:49.563903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c9df8-b8e9-48a5-afad-e57f4883376d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:49.600922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:49.601549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:49.601836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:49.602115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:49.602858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:49.603172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:49.604643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f4686-f3ef-4114-b15d-9b8b8d280ae8 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:49.628543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 290/569] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Oct 14 02:49:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:49.633520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:49.760438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea23b-33ad-4902-aad4-68d0f1afb990 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:49.761329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea23b-33ad-4902-aad4-68d0f1afb990 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:49.761824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea23b-33ad-4902-aad4-68d0f1afb990 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:49.763830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 291/570] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:49.780006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:49.780602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:49.781056 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:49.798141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394fd71-0040-4045-bcbd-de22c7a34fcc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:49.817441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:49.818956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:49.833553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833eb08-45cd-4fdd-9f06-b64bcb0d372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:49.834170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833eb08-45cd-4fdd-9f06-b64bcb0d372e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:49.834454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833eb08-45cd-4fdd-9f06-b64bcb0d372e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:49.834731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833eb08-45cd-4fdd-9f06-b64bcb0d372e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:49.850461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:49.905514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833eb08-45cd-4fdd-9f06-b64bcb0d372e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:49.907227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833eb08-45cd-4fdd-9f06-b64bcb0d372e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:49.953785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.000879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 292/571] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:49:50.053581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 280/572] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:49:50.059421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.122812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf947f-6e66-4269-94f2-b3960f53add7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.123163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf947f-6e66-4269-94f2-b3960f53add7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.123376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf947f-6e66-4269-94f2-b3960f53add7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.124892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 281/573] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:50.130157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400183-32db-4f07-959e-2107987ee8ed None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.130440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400183-32db-4f07-959e-2107987ee8ed None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.130715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20400183-32db-4f07-959e-2107987ee8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.161382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-20400183-32db-4f07-959e-2107987ee8ed None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:50.162556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-20400183-32db-4f07-959e-2107987ee8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:50.185009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bb3cb-3921-4cea-a858-2d7ce118841e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:50.221674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:50.222315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.222599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.222873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.234054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:50.235529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:50.252351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:50.253978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:50.255284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:50.255284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:50.255284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:50.255284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 293/574] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:50.261803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.270625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.335604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 282/575] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:49:50.336287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.419126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400183-32db-4f07-959e-2107987ee8ed None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.420470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11778ac4-abe0-47b0-993d-a9748c2375a2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:50.485926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:50.486554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.486849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.487636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.488285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:50.488612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:50.489977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:50.514446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 294/576] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:50.521327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.604756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20400183-32db-4f07-959e-2107987ee8ed None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:50.665029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:50.665872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.666254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.666826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.667441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:50.671733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:50.680256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:50.683160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:50.684349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:50.685432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:50.688057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce536-bb82-4c59-8e18-767d0f76636f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:50.691554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 283/577] 10.222.0.13 () {56 vars in 1129 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:50.692543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.731346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760363-1611-470e-b956-399a6b413533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:50.732225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760363-1611-470e-b956-399a6b413533 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.732615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760363-1611-470e-b956-399a6b413533 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.732963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760363-1611-470e-b956-399a6b413533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.733735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.743505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760363-1611-470e-b956-399a6b413533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:50.745219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760363-1611-470e-b956-399a6b413533 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-91760363-1611-470e-b956-399a6b413533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:50.757177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:50.758307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 295/578] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:50.759545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760363-1611-470e-b956-399a6b413533 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.807006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eee99f-833d-4ea7-ad4d-59b9c61496db None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:50.842166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9f78-216a-4d54-92b1-6bba521ca4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:50.842795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9f78-216a-4d54-92b1-6bba521ca4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.843075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9f78-216a-4d54-92b1-6bba521ca4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.843348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9f78-216a-4d54-92b1-6bba521ca4a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.854226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9f78-216a-4d54-92b1-6bba521ca4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6d0b9f78-216a-4d54-92b1-6bba521ca4a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:50.858987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:50.860003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 284/579] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:50.861285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032596d-6cbc-4bb7-8d65-65008809bdae None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.862027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032596d-6cbc-4bb7-8d65-65008809bdae None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.862027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032596d-6cbc-4bb7-8d65-65008809bdae None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.867672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 285/580] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:50.867672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032596d-6cbc-4bb7-8d65-65008809bdae None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.882165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760363-1611-470e-b956-399a6b413533 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:50.921061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:50.921666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:50.921999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:50.922222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:50.922843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:50.923144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:50.924565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:50.933808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 296/581] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:50.933808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:50.960122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.967007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:50.974149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032596d-6cbc-4bb7-8d65-65008809bdae None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.007912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.008573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.008866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.009144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.009837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:51.010149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.011597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd48b72-c319-4e8f-9db3-c4bb791c5974 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.025176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 286/582] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.026176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.026468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.026746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.045517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:51.046744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:51.047255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97be47-8058-41aa-8237-5dd838bf61b0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.084653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.085261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.085543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.085819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.086480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:51.086785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.088148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.101865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 297/583] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:49:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.101865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.122758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 287/584] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:51.133442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.199995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:51.216635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e633e6-ab07-411e-82b6-d1fff1357ac9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.245896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:51.253211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.253818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.254097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.254369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.255000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:51.255306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.256718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.261922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 298/585] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.262717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.271369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c45b0c-4931-4b77-a6fb-fe6b58a73701 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.308725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.309316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.309597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.309862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.310578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=3ec4a4200e034887a5e119c109dea1f4) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:51.310885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.312305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd599aa-3977-4fca-a001-363d539dfe62 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.325416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 288/586] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/role_assignments?user.id=3ec4a4200e034887a5e119c109dea1f4&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.325416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fdf15-be09-4dee-9bc7-1cbd27103238 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.325416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fdf15-be09-4dee-9bc7-1cbd27103238 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.325416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fdf15-be09-4dee-9bc7-1cbd27103238 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.325416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 289/587] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:51.326376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fdf15-be09-4dee-9bc7-1cbd27103238 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.383320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3301c-a5d7-41c4-9eec-56b8efb7e33a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.423280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.423926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.424245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.424561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.436763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.438253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.447661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-d40d3939-c4c4-4181-8aa1-3113b4e1c83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:51.455030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:51.464140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 299/588] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.465361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.468646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fdf15-be09-4dee-9bc7-1cbd27103238 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.478653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:51.480299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:51.509960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.510822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.511099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.511371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.512067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] RBAC: Adding query filter params (interface=public, service_id=0c60c711a0d343a18a56b8472e359d74, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:51.512367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.514018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.521883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 290/589] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/endpoints?service_id=0c60c711a0d343a18a56b8472e359d74&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.522692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.540555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:51.567036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 300/590] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:51.567694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.659159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad805d-9f0c-419d-84cb-a2cb54cb71f2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.673750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f7330-1b8b-4744-9ef8-382fb039daa3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.705331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:51.709409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.710744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.711257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.711591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.711847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] PATH_INFO: `/v3/services/network` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.712406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.712791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.712973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.713247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.713985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:51.714386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.714976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.715972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:51.726812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:51.738675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:51.739529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:51.740277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 301/591] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.740277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.740452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 291/592] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:51.740452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.835197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:51.850405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f935c-3169-4c16-93c5-0a55c0ba2e96 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.858621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa2e9c-5148-4b28-b291-71b417e37c28 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:51.890394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.891009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.891291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.891571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.892183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.893639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.896715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:51.897594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:51.898097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:51.898579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:51.898685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 302/593] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:51.909517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.909894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:51.911530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:51.925152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:51.926168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 292/594] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:51.927118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:51.994925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.044023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e71faf-0c07-4da2-b7a4-340ebe771ab6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.065414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c499-8bd8-4fd8-8e15-7d39573ad67a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.081135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.081810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.082090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.082362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.090390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.095172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:52.101116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:52.106290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 293/595] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:52.107136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.117531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.118156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.118443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.118716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.119357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] RBAC: Adding query filter params (name=network) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:52.119666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.121084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.129587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 303/596] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:49:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:52.130420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.222961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e4587-4d4b-4896-bc2f-7bbde97504fc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.253411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dbd34-f42b-4404-940a-7536611812ee None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.258599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.259327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.259712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.260092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.261119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:52.261534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.263475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.273813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.290603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 294/597] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:52.292119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.294774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.295626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.295982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.296323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.297950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:52.298349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.299840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.316476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 304/598] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:52.318463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.364546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.411981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0118-8057-4c39-87d4-bcc5e73725cd None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.451198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d245-3ad4-420b-9c36-b78e59ff34dd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.457411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.458301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.458797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.459760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.460623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] RBAC: Adding query filter params (type=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:52.461557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.463741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.471631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 295/599] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:52.472720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.494713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.495444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.495811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.496158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.547879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.567686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.569302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.603551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecc1e2-4bfb-4c73-a151-377765de3f22 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.624733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.639844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.640601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.640894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.641275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.657174 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.662423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:52.685675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:52.686867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:52.687973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:52.687973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:52.687973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:52.692531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 296/600] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:52.693513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.712514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 305/601] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:49:52.713635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.809623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.812580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92c8a-79d1-4b69-8fc4-5721fa0c7e36 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.835799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503f0fc-c22e-4e26-bc0f-f1fa2ffe97af None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:52.852484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.853431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.853863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.854358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.855245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] RBAC: Adding query filter params (interface=public, service_id=d325fa6d37b94df7824d5bcaf35700b3, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:52.855768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.857550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.863002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 297/602] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/endpoints?service_id=d325fa6d37b94df7824d5bcaf35700b3&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:52.864322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.876585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:52.877711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:52.877997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:52.878267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:52.879214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:52.879522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:52.881149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:52.900497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 306/603] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:52.902028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:52.909495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:52.988249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd45cc6-b2f1-4d8d-9847-80f114e17ff5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.025011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.025907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.026347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.026847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.032183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901d5fd-1502-473b-a2fe-8e62826dc76e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.037742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.039428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:53.055347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:53.056452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:53.057468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:53.057468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:53.057468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:53.064308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 298/604] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:53.065978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.072463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.073169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.073520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.073862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.074532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.075963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.082363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 307/605] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:49:52 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:53.084082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.095559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:53.259362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:53.281963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04477c-7764-4a0a-b887-8965fc43e080 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.284642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f507d0c-0542-4f68-8362-d1acbe1895a7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.339663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.340729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.340976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.341405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.341655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.341776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.341958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.342428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.342600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:53.342912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.344347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.352484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.354803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.361036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 308/606] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:53.366998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:53.368297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:53.370159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 14 02:49:53.371102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:53.374751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 299/607] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:53.381525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.475846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:53.502445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da641-22de-4a02-98e2-ed23b9bfa655 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.547093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.548096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.548608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.549902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.550893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:53.551825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.553581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.558732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389bf4b-07ff-4e0d-b98d-b7a51cb5db92 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.575999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 300/608] 10.222.0.13 () {56 vars in 1135 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:53.582738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.594022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:53.661222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.662558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.663058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.663504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.679689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.681458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.702116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a47a6-a2f0-44e5-9cd7-f1be3d40e470 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:53.707596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:53.708750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:53.709886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:53.718094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 309/609] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:53.725397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.744802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ff8b0-d57c-425b-994a-5b3170b4feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.745411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff8b0-d57c-425b-994a-5b3170b4feec None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.745695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff8b0-d57c-425b-994a-5b3170b4feec None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.745974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ff8b0-d57c-425b-994a-5b3170b4feec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.819287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ff8b0-d57c-425b-994a-5b3170b4feec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.820778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ff8b0-d57c-425b-994a-5b3170b4feec None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.836772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:53.837628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494209e-4e35-4099-9f37-9e063cd6febe None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:53.868465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:53.871801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:53.872542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.872910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.873286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.874171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:53.874518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:53.876057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30438939-c8ab-4d2e-ad61-5883bb150bca None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:53.889327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 310/610] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:53.890853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb1e3-d9b9-4642-8deb-5468f2cfc0e7 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.891164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb1e3-d9b9-4642-8deb-5468f2cfc0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.891531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedb1e3-d9b9-4642-8deb-5468f2cfc0e7 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.897546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 311/611] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:53.897546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedb1e3-d9b9-4642-8deb-5468f2cfc0e7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:53.934100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 301/612] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 02:49:53.935691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:53.936189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:53.936707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:53.955858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:53.957530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:54.006715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedb1e3-d9b9-4642-8deb-5468f2cfc0e7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.036775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 302/613] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:54.038139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.043717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.044409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.044694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.044967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.045765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=aac2bc8b15a942438997f94fa9fdf354) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:54.046081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.056416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a921e7-5174-4e2c-be94-106665eed617 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.056416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 312/614] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:53 2022] GET /identity/v3/role_assignments?user.id=aac2bc8b15a942438997f94fa9fdf354&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:54.116843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:54.200178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0cec-ded1-4b31-8b3d-a125b0d70354 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.246163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.246810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.247095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.247370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.260070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4e1e-61b1-41d7-a8bc-fe7cd3fcb7f1 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.260650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4e1e-61b1-41d7-a8bc-fe7cd3fcb7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.261155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c4e1e-61b1-41d7-a8bc-fe7cd3fcb7f1 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.262711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 313/615] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:54.268508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.269156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.269615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.269866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.271081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:54.288660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:54.289675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:54.290579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:54.290579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:54.290579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:54.290579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 303/616] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:54.295084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:54.295221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.296799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:54.357852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:54.393715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 314/617] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:54.404587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:54.417662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e21b-bd33-4be5-8861-ee472bdbf37c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.418616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.470718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.471995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.472272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.472567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.473213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:54.473512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.475113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.492803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 304/618] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:54.498595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.612808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6991fc-f2c0-46f8-b414-1756c6bcf145 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.630526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30c2c2-cf3d-4082-9379-792cbae90c76 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.654943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.655644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.655926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.656199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.671539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.677658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:54.696408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:54.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:54.698243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 305/619] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:54.698813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.700308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.700308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.700857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.700857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.704413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.704413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:54.716368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:54.717434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:54.718351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 315/620] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:54.719172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.720537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:54.768957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:54.812157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2214-b339-47dc-9ac0-81774821a66c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.835160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201c7d-8bf0-4cc1-ac31-5b391d76057c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:54.848707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.849957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.850441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.850934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.851716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.853331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:54.862950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:54.863935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 14 02:49:54.864813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:54.867530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 306/621] 10.222.0.13 () {56 vars in 1129 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:54.868535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.873286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:54.873759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:54.874050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:54.874385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:54.875143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:54.875503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:54.876968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:54.896036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 316/622] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:54.896036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:54.949482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:54.979778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09a052-8454-41d1-bdb8-6c6019bf19e3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:55.004254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87d14d-9159-4055-bdf7-f2b68c372cdb None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:55.005968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:55.016344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:55.017329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.017831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.018297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.019161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:55.019666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:55.021266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:55.026544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 307/623] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:55.027643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:55.044827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:55.045539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.045833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.046110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.046885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:55.047196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:55.048765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:55.054838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 317/624] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Oct 14 02:49:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:55.055807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:55.133085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20013-ecb8-4f1a-9d7a-648eeca28645 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:55.168268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:55.171377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616840d9-b9f6-4f5d-9ec2-ed3ca5bd8041 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:55.171490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.171490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.171490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.171490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=972095d3e6cb4472b1c465a780138806) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:55.171490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:55.172926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:55.176807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:55.185966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 308/625] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:49:55 2022] GET /identity/v3/role_assignments?user.id=972095d3e6cb4472b1c465a780138806&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:55.187275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:55.210288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:55.210951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.211471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.211471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.212119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:55.212451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:55.214116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:55.224455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 318/626] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:49:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:55.348714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5b0e9-1d72-447d-9ab4-88869aee866d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:55.393864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:55.394500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.394783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.395058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.395804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:55.396115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:55.397699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569bb15-3f73-41c8-aa90-c50d8ad2962b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:55.408126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 309/627] 10.222.0.13 () {56 vars in 1124 bytes} [Fri Oct 14 02:49:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:55.414740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:55.453651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:55.533860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6d876-5d1c-451a-b9b3-2ce3d6f2eee5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:55.573102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:55.573740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.574007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.574282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.574953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:55.576303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:55.610571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb98290-b576-454e-99c4-62166da3d101 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.610761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb98290-b576-454e-99c4-62166da3d101 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.611029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb98290-b576-454e-99c4-62166da3d101 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.612656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 310/628] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:55.617901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:55.618184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:55.618450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:55.637465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:55.638893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:55.699418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 319/629] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:49:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:55.725080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:55.746163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 311/630] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:49:56.100991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:56.195690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:56.212729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57f566-5afc-4766-8d55-87e47d7f920b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:56.254147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:56.254788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:56.255062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:56.255324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:56.255911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:56.257302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:56.266494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:56.267539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:56.268465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 320/631] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:56 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:56.280610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:56.434386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb90e-9d66-4f29-89c8-bf0b031396f6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:56.480681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:56.481301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:56.481603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:56.481859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:56.482495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] RBAC: Adding query filter params (name=network) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:56.482802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:56.484187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:56.489486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 312/632] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:49:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:56.495312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:56.638193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526664d3-80f8-4e34-8086-4c83e8027ed9 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:56.692080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:56.693006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:56.693427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:56.693853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:56.694621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:56.695066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:56.696605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e3975-0064-4cf9-b5f6-ae3a80d3d5b2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:56.702326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 321/633] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:49:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:56.710352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:56.786250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f989-3592-402d-b9b6-b102270b346a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:56.787605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f989-3592-402d-b9b6-b102270b346a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:56.788779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f989-3592-402d-b9b6-b102270b346a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:56.790620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 322/634] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:56.800863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:56.801381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:56.802121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:56.803534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:56.837354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:56.838885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:56.856826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:56.886686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2028-128a-410e-bce6-5e983f219991 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:56.953683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:56.954222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:56.954504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:56.954778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:56.956193 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:56.958713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:56.967216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 323/635] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:57.034544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 313/636] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:49:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:49:57.296698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:57.404434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eb5d2-5a94-4b0e-acf9-37500b8fb1aa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:57.451331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe35ac1-bd48-49cf-ba79-cf4ab7b8c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:57.452328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35ac1-bd48-49cf-ba79-cf4ab7b8c141 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.452902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35ac1-bd48-49cf-ba79-cf4ab7b8c141 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.453393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35ac1-bd48-49cf-ba79-cf4ab7b8c141 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.464075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:57.466976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe35ac1-bd48-49cf-ba79-cf4ab7b8c141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-bfe35ac1-bd48-49cf-ba79-cf4ab7b8c141 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:49:57.472162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:57.473158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:57.474618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 324/637] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:49:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:57.479244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:57.602312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91690126-b2ea-4ffc-b88f-238759225dba None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:57.615411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:57.640534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:57.641152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.641611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.642278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.643207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:57.643867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:57.645844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:57.657860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 314/638] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Oct 14 02:49:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:57.661069 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d277d-f465-4753-9f9e-74dd7476cfe4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.661614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d277d-f465-4753-9f9e-74dd7476cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.662773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d277d-f465-4753-9f9e-74dd7476cfe4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.662911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:57.664357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 325/639] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:57.678749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.679456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.679974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.707409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:57.708985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:57.777298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ef644-fa25-448a-a7d6-90db72f0c6a3 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:57.808476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 326/640] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:49:57.820675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:57.821486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.821919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.822344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.832998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:57.834699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-36453340-22f8-4360-9614-bc0256c53a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:57.850076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:57.851215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:57.852414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:57.852414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:57.852414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:57.854157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 315/641] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:57.861103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:57.900429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5ba30-f759-4051-8eff-5b3452980213 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.900429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5ba30-f759-4051-8eff-5b3452980213 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.900429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5ba30-f759-4051-8eff-5b3452980213 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.901960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 316/642] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:49:57.906934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:57.907211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:57.907477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:57.926773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:57.928034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:57.948731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:57.968751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf644fbd-7185-4543-a5f3-67f808714e0b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.003789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.012420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.012420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.012420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.012420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.015622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:58.015622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.015756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 317/643] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:58.015831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.025702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 327/644] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:58.031107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.098495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.143668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ac9c3-d95d-4203-8b1c-c7cdd0bef33f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.192127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.193703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.193997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.199227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.202752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.204681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:49:58.221949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:58.222901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:58.224512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 318/645] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:58.228480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.232781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa832742-7ca3-4dee-808b-fce843e720cc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.251447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.277169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.278998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.279544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.280032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.280920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.283039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.340477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 328/646] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:49:58 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:49:58.340477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.357082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84f868-54c1-4e69-9f7d-fd455ae7355c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.398745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.413700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.414321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.414600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.414874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.415779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:58.416432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.418248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.444576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 319/647] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:49:58.447921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.470171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15e2bd-de80-4637-adaa-3ce052137d0e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.516298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.516727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.517014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.517294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.518454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.519939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:58.531503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:58.532619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:49:58.534121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:49:58.538196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 329/648] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:58.539312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.560790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.602509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaf23e-8d3f-4fa7-a033-07e72f4bf3da None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.645395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.646034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.646319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.646598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.659464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69cb6f-9497-445e-877a-c57653e9ff24 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.661110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.663369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.674445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1667c4df-cd38-4b04-bc43-c635ad9188ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:49:58.680304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:58.687231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 320/649] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509518-bf06-4fcd-aa9d-7c53056f994b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509518-bf06-4fcd-aa9d-7c53056f994b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509518-bf06-4fcd-aa9d-7c53056f994b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 321/650] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:49:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:49:58.688116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09509518-bf06-4fcd-aa9d-7c53056f994b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.702398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.703012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.703296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.703570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.704203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:58.704547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.706592 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c54c6-0ad7-4606-8e73-3a411752f695 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.716962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 330/651] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:58.716962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.716962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.716962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.733835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:49:58.735040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:49:58.794991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09509518-bf06-4fcd-aa9d-7c53056f994b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.820414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 331/652] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:49:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:49:58.820414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.823986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.839560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.840175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.840477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.840751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.841514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:58.841814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.843236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.860209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 322/653] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:58.861147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:58.930093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dee03f-b1ee-4fe7-a3cf-b560f6969523 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.956888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:58.968972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:58.969936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:58.970637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:58.971118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:58.971961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:58.972590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:58.974326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:58.979144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd908b8f-17b3-4a47-83c5-8c0d50a6d047 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:58.980605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 332/654] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:59.019125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:59.020039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:59.020515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:59.020964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:59.028764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:59.030470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:49:59.043266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:59.044488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:49:59.045631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:59.047840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 323/655] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:49:59.057849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:59.119307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:59.171827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:59.175081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540c53-cdeb-41e7-ac7c-d49837bf345e None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:59.222897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:59.223531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:59.223945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:59.224356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:59.225145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:59.225536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:59.227603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:59.239982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f48ac0-93d1-4cdb-a7c7-b994a5367700 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:59.244188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 333/656] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:49:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:59.250776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:59.278416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:59.279404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:59.279890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:59.280451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:59.281253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:59.282952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:49:59.297628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:49:59.299231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:49:59.300847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 324/657] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:49:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:49:59.302837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:59.305674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:59.387498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87098-c929-4916-ac1e-4ba021b2092d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:59.414816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f126c-ba47-4bcb-931f-2c92da22d7f0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:59.418183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:49:59.434344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462bc92-4a6a-43e3-8cd7-756ad4e385ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:59.435166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462bc92-4a6a-43e3-8cd7-756ad4e385ce None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:59.435451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462bc92-4a6a-43e3-8cd7-756ad4e385ce None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:59.435793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462bc92-4a6a-43e3-8cd7-756ad4e385ce None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/aac2bc8b15a942438997f94fa9fdf354/roles/fe65d40770b64b989f3a5590a464cc45` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:59.438125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462bc92-4a6a-43e3-8cd7-756ad4e385ce None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=aac2bc8b15a942438997f94fa9fdf354, role_id=fe65d40770b64b989f3a5590a464cc45)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:59.439658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462bc92-4a6a-43e3-8cd7-756ad4e385ce None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:59.455313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:59.458803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:59.458803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:59.458803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:59.458803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:59.458803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:59.458803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:59.463585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 325/658] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:49:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:49:59.469196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:49:59.501812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 334/659] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:49:59 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/aac2bc8b15a942438997f94fa9fdf354/roles/fe65d40770b64b989f3a5590a464cc45 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:49:59.586744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e570f31-dbeb-4ba8-9545-f89062fd0f1d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:49:59.625984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:49:59.626647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:49:59.626936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:49:59.627215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:49:59.627928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:49:59.628248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:49:59.629790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ade424-6fea-4de9-a75a-cb20dc9736c1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:49:59.635632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 326/660] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:49:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:00.681239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732886d-e36e-4ad4-af0f-59213da3fbf4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:00.681714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732886d-e36e-4ad4-af0f-59213da3fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:00.681795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732886d-e36e-4ad4-af0f-59213da3fbf4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:00.683406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 335/661] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:00.688505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0988-95a6-4830-ac4d-3ea45d6ff80b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:00.688894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0988-95a6-4830-ac4d-3ea45d6ff80b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:00.689130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b0988-95a6-4830-ac4d-3ea45d6ff80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:00.707841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b35b0988-95a6-4830-ac4d-3ea45d6ff80b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:00.709071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b35b0988-95a6-4830-ac4d-3ea45d6ff80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:00.735768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:00.779425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 327/662] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:00 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:01.053793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732886d-e36e-4ad4-af0f-59213da3fbf4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:01.156951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:01.167676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732886d-e36e-4ad4-af0f-59213da3fbf4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:01.203604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:01.204585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.205572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.208706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.208706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:01.208706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:01.208943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533afb-938c-4d01-838a-647807c1eb02 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.208943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533afb-938c-4d01-838a-647807c1eb02 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.209308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af533afb-938c-4d01-838a-647807c1eb02 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.210560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 328/663] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:01.215709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.215999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.216281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:01.220872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:01.221773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:50:01.222657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:01.225632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 336/664] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Oct 14 02:50:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:01.233064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:01.238667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:01.240100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:01.332222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 329/665] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:01.358262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f156-bd30-4b7e-a238-5db94fb81816 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:01.393112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:01.394249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.394534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.394864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.395505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:01.395812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:01.397258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:01.402254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 337/666] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:01.408421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:01.504550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:01.514388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e6368-a3a7-4a2f-ad0a-493c96ee7cf8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:01.556412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:01.557401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.557873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.558424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.559263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:01.559773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:01.561419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:01.567832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 330/667] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:01.576532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:01.600915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:01.624029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:01.695112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8522c6-5e7d-469b-acb5-70bd5ab99e01 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:01.731917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9761c89-6fc3-4e6f-a519-e30e81da496e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:01.732523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:01.732625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.732881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.733161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.734126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] RBAC: Adding query filter params (interface=public, service_id=630c3148341f4ace85efb81d24b4709b, region_id=RegionOne) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:01.735366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:01.736913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813faae-386d-4eca-8f98-f63cccb05915 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:01.746168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 338/668] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:50:01 2022] GET /identity/v3/endpoints?service_id=630c3148341f4ace85efb81d24b4709b&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:01.747294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfa0fa-4e89-48b0-819b-d5bea0b476db None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.747587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfa0fa-4e89-48b0-819b-d5bea0b476db None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.747868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfa0fa-4e89-48b0-819b-d5bea0b476db None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.754404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 339/669] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:01.754404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfa0fa-4e89-48b0-819b-d5bea0b476db None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:01.780707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec98ab8-3011-473e-94b2-c782581afd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:01.781324 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec98ab8-3011-473e-94b2-c782581afd48 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.781606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec98ab8-3011-473e-94b2-c782581afd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.781885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec98ab8-3011-473e-94b2-c782581afd48 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.782554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec98ab8-3011-473e-94b2-c782581afd48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:01.783953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec98ab8-3011-473e-94b2-c782581afd48 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:01.844447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 331/670] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:01 2022] POST /identity/v3/services => generated 241 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:01.844646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:01.845248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.845545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.845830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.867296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:01.868976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:01.879604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfa0fa-4e89-48b0-819b-d5bea0b476db None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:01.882718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:01.919719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59031a9-54fc-4c01-b31f-dbdbf1b0ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:01.920670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59031a9-54fc-4c01-b31f-dbdbf1b0ab0e None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.921109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59031a9-54fc-4c01-b31f-dbdbf1b0ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.921590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59031a9-54fc-4c01-b31f-dbdbf1b0ab0e None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.922391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59031a9-54fc-4c01-b31f-dbdbf1b0ab0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:01.923964 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59031a9-54fc-4c01-b31f-dbdbf1b0ab0e None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:01.930635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 340/671] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:50:01 2022] GET /identity/v3/services => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 02:50:01.936416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74fa7-3aae-440c-b957-a35c644e1a81 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.936416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74fa7-3aae-440c-b957-a35c644e1a81 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.936416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa74fa7-3aae-440c-b957-a35c644e1a81 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.936416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 341/672] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:01.940515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:01.940900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:01.941250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:01.957357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 332/673] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:01 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:01.962778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:01.964017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:02.050865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 342/674] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:01 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:02.225162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:02.317162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:02.329189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9909212-b27f-47bc-ba62-a1d842dcf23a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:02.369571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:02.370522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:02.370812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:02.371367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:02.384477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:02.391161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:02.392149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:50:02.393057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:02.393714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 333/675] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:50:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:02.401568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:02.412736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:02.414378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:02.439579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dfd06d-d4ee-4493-a091-ea424516ce85 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:02.489539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:02.490079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:02.490384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:02.491009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:02.491688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:02.493710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:02.516254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1064-5de4-4d32-b49e-c741b98aeb86 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:02.554185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:02.555144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:02.555577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:02.556098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:02.557138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:02.557645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:02.564672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 343/676] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:02 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:02.564847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:02.571088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 334/677] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Oct 14 02:50:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:02.577306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:02.713541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa2366-97d1-45a4-8c77-dc00a4ecd3e5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:02.747420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:02.751123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:02.751842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:02.752105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:02.752373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:02.763421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:02.764899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:02.780199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:02.781351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:02.782255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:02.782255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:02.782255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:02.785447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 344/678] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:02.790678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:02.863233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:02.902192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f22a05-0c85-404f-ace4-251844a98c3b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:02.937519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:02.938221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:02.938505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:02.938779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:02.939482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:02.939827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:02.941297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:02.955339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 335/679] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:02.960577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:03.062969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d6189-ee54-4ad0-8dbb-eebb4b4536a5 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:03.102004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:03.103063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:03.103569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:03.104050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:03.111882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:03.113625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:50:03.125607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:03.127123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 14 02:50:03.128124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:03.130681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 345/680] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:50:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:03.136119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:03.247086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e62fae-ac0a-4a38-85d3-85f9a0302f8d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:03.280707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:03.284670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:03.285281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:03.285563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:03.285836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:03.286570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:03.286879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:03.288313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:03.306342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 336/681] 10.222.0.13 () {56 vars in 1149 bytes} [Fri Oct 14 02:50:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:03.311590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:03.357639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:03.416971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef581ea-4c81-4687-8e51-f3c6853fbd2d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:03.451145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:03.451753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:03.452030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:03.452301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:03.524269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:03.525975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:03.569760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:03.640834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 346/682] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:50:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:50:03.645500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:03.762982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8456d-49d9-45e9-a37e-9e607f410589 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:03.799568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:03.801001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:03.801456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:03.801895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:03.812623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:03.814968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:03.830275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:03.831251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:03.832210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:03.832210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:03.832210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:03.833965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 337/683] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:03.839689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:03.944700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c119cc1-d23b-43c6-9ddf-6453d4730625 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:03.980841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:03.981735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:03.982159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:03.982575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:03.983348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:03.983796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:03.985406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911914a-3f09-4eb9-9bde-7b5bcbaacc5f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:03.997747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 347/684] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:04.003984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.052267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:04.112015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ea98f-8a9b-4c33-a107-66242be4074f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:04.145631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2b85-316c-4a3c-b835-21ec69e999cd None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.146037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2b85-316c-4a3c-b835-21ec69e999cd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.146420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b2b85-316c-4a3c-b835-21ec69e999cd None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.148103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 348/685] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:04.148313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:04.149005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.149256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.149535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.153191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b832-414f-430e-bf19-f5e967b5c3d1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.153478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b832-414f-430e-bf19-f5e967b5c3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.153768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64b832-414f-430e-bf19-f5e967b5c3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.158385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:04.159845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:04.160499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:50:04.172355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:04.173386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:04.174281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 338/686] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:04.181324 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.187101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7b64b832-414f-430e-bf19-f5e967b5c3d1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:04.189277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7b64b832-414f-430e-bf19-f5e967b5c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:04.267476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 349/687] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:04.290213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba4ad5-1685-46c1-9880-e53bc7774153 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:04.292674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:04.312258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611530d8-0400-447a-8868-2aad6a7cea4e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.312575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611530d8-0400-447a-8868-2aad6a7cea4e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.312844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611530d8-0400-447a-8868-2aad6a7cea4e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.315003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 350/688] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:04.319930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.320216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.320529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.326694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:04.327308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.327596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.327873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.328600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:04.328915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:04.330391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:04.339119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:04.340340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:04.343273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 339/689] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:04.348912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.424740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 351/690] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:04.452572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395039ff-5386-4f98-b13c-66f2e6aedbfa None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:04.487880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:04.488577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.488854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.489123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.489855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] RBAC: Adding query filter params (role.id=fe65d40770b64b989f3a5590a464cc45, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=aac2bc8b15a942438997f94fa9fdf354) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:04.490164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:04.491595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:04.499196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 340/691] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/role_assignments?user.id=aac2bc8b15a942438997f94fa9fdf354&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=fe65d40770b64b989f3a5590a464cc45 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:04.562211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.636901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:04.679330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f381938-2ea0-440b-998e-6f3c77a581fb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:04.693602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.718368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:04.719026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.719308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.719582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.720788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:04.721542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:04.723323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:04.733084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:04.737957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:04.738784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 352/692] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:04.743722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.826619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf281a-8c5e-4f9b-9d75-20774ac36dee None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:04.864369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:04.865029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.865312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.865581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.868039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:04.868181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bbad-c413-43a1-8f3c-462aa51d6f2a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:04.868632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:04.878558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:04.879561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:04.880467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 341/693] 10.222.0.13 () {56 vars in 1132 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:04.885758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.901330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:04.911312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:04.911942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.912223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.912536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.913186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:04.913471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:04.914872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f1d9b-0222-448b-b277-0c1ba09f2e24 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:04.920607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 353/694] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:04.921899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177641-4540-41f9-a37e-1e0e14be001a None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:04.922188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177641-4540-41f9-a37e-1e0e14be001a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:04.922463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29177641-4540-41f9-a37e-1e0e14be001a None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:04.924516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 354/695] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:04.925949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177641-4540-41f9-a37e-1e0e14be001a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:04.996883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:05.012680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235703c0-2bae-4f41-928c-c2a0fba62efe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.043038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29177641-4540-41f9-a37e-1e0e14be001a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.049851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.050470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.050870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.051147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.051781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:05.052084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.053514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25fbaa1-a423-4c02-a3f6-9f51650d1dd3 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.058908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 342/696] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:05.060583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.061039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.062054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.081721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:05.082827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:05.086825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.087441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.087725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.087988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.089193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:05.089500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.090859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.096170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 355/697] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:05.096837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.157283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:05.169037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 343/698] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:05.169037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.209434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d2ac-7808-4c24-8cde-dd3baa05ccab None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.247672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.248348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.248658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.248930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.249564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:05.249866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.251383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.256613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 356/699] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:05.262339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.281025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:05.308469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097728a-3b51-4adc-aecb-6f54e0f8e330 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.351524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.352519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.353033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.353570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.354452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] RBAC: Adding query filter params (interface=public, service_id=db4f4bfc3d144691acd99c3da1835d7c, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:05.354954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.356639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.366126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 344/700] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:50:05 2022] GET /identity/v3/endpoints?service_id=db4f4bfc3d144691acd99c3da1835d7c&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:05.376423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.377943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcf24c-eee0-4301-8946-66a5c84853d2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.396638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:05.414044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.414654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.414931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.415202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.415873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.417274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.491439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a6b99-b93f-4c59-bd1c-490575fc62fa None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.503276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 357/701] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:50:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:05.503276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.536769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.537397 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.537684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.538022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.538699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.540149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.556916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 345/702] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:50:05 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 02:50:05.641891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85cb3-855a-4e49-a4b8-48bcf18217a2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.691062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.691748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.692037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.692310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.692967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.694457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:05.709115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:05.710323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:05.711185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 358/703] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:50:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:05.722257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.736425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:05.872239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ce9b7-fa0c-4ed3-8dd9-ed7f6039ab28 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:05.908173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:05.908724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:05.909292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:05.909292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:05.909882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:05.910182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:05.911602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:05.916821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 346/704] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:50:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:05.922574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:05.969509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:06.068223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b47bad-e4c3-45c7-8564-ba19f00fa18f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:06.114689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:06.115306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:06.115585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:06.115855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:06.116517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:06.116870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:06.118285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:06.123850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 359/705] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:50:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:06.129970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:06.211336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:06.245244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545b119-7e2a-4ce7-9821-a30fc06b3388 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:06.280437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:06.281050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:06.281328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:06.281598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:06.282297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] RBAC: Adding query filter params (interface=public, service_id=4a5223c7906049a5bee715995a251327, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:06.282628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:06.283997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a08d-4177-41a1-b2b8-1583d3b97e00 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:06.289500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 347/706] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:50:06 2022] GET /identity/v3/endpoints?service_id=4a5223c7906049a5bee715995a251327&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:06.295069 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:06.400514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561185e-11bc-4a5c-b41b-e79d9e47de5d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:06.402390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:06.440600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bde9d5-4068-4500-bae4-2b384e92a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:06.441534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bde9d5-4068-4500-bae4-2b384e92a972 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:06.441974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bde9d5-4068-4500-bae4-2b384e92a972 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:06.442388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bde9d5-4068-4500-bae4-2b384e92a972 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:06.443144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bde9d5-4068-4500-bae4-2b384e92a972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:06.444685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bde9d5-4068-4500-bae4-2b384e92a972 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:06.451332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 360/707] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:50:06 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 02:50:06.948701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee198-6875-47f5-b241-7bbf6e7e725e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:06.949196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee198-6875-47f5-b241-7bbf6e7e725e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:06.949442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee198-6875-47f5-b241-7bbf6e7e725e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:06.951121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 348/708] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:06.956443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:06.956882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:06.957182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:06.975758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:06.976963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:07.046367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 361/709] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:07.311072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffee198-6875-47f5-b241-7bbf6e7e725e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:07.418267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffee198-6875-47f5-b241-7bbf6e7e725e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:07.452094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:07.453495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:07.454675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:07.454935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:07.455208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] PATH_INFO: `/v3/services/image` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:07.455781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:07.457167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:07.465860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:07.471015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:07.471876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 349/710] 10.222.0.13 () {56 vars in 1105 bytes} [Fri Oct 14 02:50:07 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:07.474612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:07.573892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:07.580362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66afd8f-d8dd-4c6f-81b1-bbb612a9d22e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:07.615212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:07.616245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:07.616804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:07.617274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:07.618136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] RBAC: Adding query filter params (name=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:07.618650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:07.620207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c00da-8860-445e-a6c5-ed26beec9814 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:07.625613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 362/711] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:07.631826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:07.744820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893bc6a-80e9-4312-8304-10e6a0b24c0b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:07.783437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:07.784107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:07.784409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:07.784683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:07.785330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:07.785704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:07.787195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a40c5-481c-495e-a88b-c3c5b87976e8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:07.792740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 350/712] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:07.901415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcac0-639d-4575-ad5c-f6652a61411e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:07.902029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcac0-639d-4575-ad5c-f6652a61411e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:07.902523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebcac0-639d-4575-ad5c-f6652a61411e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:07.904353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 363/713] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:07.909883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94a2e-7d34-44ae-bf0f-8b164153ef02 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:07.910167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94a2e-7d34-44ae-bf0f-8b164153ef02 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:07.910441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94a2e-7d34-44ae-bf0f-8b164153ef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:07.930404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-beb94a2e-7d34-44ae-bf0f-8b164153ef02 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:07.931630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-beb94a2e-7d34-44ae-bf0f-8b164153ef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:07.995186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:08.012752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 351/714] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:08.114529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f3e0-e104-4699-ab28-0507c024a225 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.115038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f3e0-e104-4699-ab28-0507c024a225 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.115114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f3e0-e104-4699-ab28-0507c024a225 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.116659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 364/715] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:08.125136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.125136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.125136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.141757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:08.143279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:08.215513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 352/716] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:08.278156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f3e0-e104-4699-ab28-0507c024a225 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:08.386471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f3e0-e104-4699-ab28-0507c024a225 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:08.421068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:08.421697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.421976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.422251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.423389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:08.424780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:08.433509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:08.434572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:08.435418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 365/717] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:08.442582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:08.508248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:08.541993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172553f-f6f4-4ec0-9ec0-37a7f1efe51a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:08.544220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:08.567102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:08.585844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:08.586801 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.587279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.587747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.588697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:08.592026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:08.592026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:08.597599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 353/718] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:08.609190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:08.639230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3516cc4-7cfc-4c55-96c2-f32ab0df3c89 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:08.678888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:08.680299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.680814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.681278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.682607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:08.684478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:08.693811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:08.694809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:08.695634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:08.698388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 366/719] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:50:08.706978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:08.733355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23d464-837a-4b83-8239-267b8afc9e1b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:08.769087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:08.769612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.769890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.770162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.770787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:08.771090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:08.772472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352ece-2bb2-49f0-a736-95596f89ae19 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:08.781857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 354/720] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:08.783692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a76ac-d2c4-4e63-9921-6a23c24a3f23 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.783973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a76ac-d2c4-4e63-9921-6a23c24a3f23 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.784247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a76ac-d2c4-4e63-9921-6a23c24a3f23 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.788465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 355/721] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:08.788465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a76ac-d2c4-4e63-9921-6a23c24a3f23 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:08.804273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:08.817208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e76ae-5fb3-48f6-9f90-194c21fcf581 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:08.837870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:08.854380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:08.855165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.855507 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.856256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.856947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:08.857257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:08.858749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68087-f9eb-41f4-b9e6-d07c0c788cf0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:08.863942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 367/722] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:08.865138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.865427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.865700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.883600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:08.884827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:08.898054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a76ac-d2c4-4e63-9921-6a23c24a3f23 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:08.933504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:08.934125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:08.934379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:08.934764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:08.935421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:08.936819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:08.964417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 368/723] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:08.964417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:09.003543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 356/724] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:50:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:09.058850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:09.080708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d37af-26cf-4a59-a7cd-4627220fb25b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:09.126526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:09.127190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:09.127449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:09.127726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:09.128440 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:09.128752 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:09.130202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:09.136015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 369/725] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:09.273791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:09.380737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387041d9-7f2a-42cb-b69f-ce6db500aa25 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:09.384431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:09.417239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:09.418233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:09.418777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:09.419255 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:09.420047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:09.421654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:09.431995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:09.433070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 14 02:50:09.433920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:09.436472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 357/726] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:50:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:09.443168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:09.549822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410eab7-9cb4-469c-b59c-06141cea08b3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:09.585528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:09.586577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:09.587058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:09.587538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:09.588409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:09.588918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:09.590492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:09.595933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 370/727] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:50:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:09.601862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:09.712258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1a8e3-b79f-4e8a-b40d-e51414dac0e7 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:09.746216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:09.746821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:09.747100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:09.747370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:09.748005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:09.748304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:09.749693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2c506-451b-4b24-bb1b-5320389611a5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:09.755702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 358/728] 10.222.0.13 () {56 vars in 1114 bytes} [Fri Oct 14 02:50:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:09.765521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:09.775084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:09.875586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9426-e728-4c13-8351-0e76525d11bb None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:09.911756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1e042-f636-4036-934a-405ec4e0f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:09.912895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1e042-f636-4036-934a-405ec4e0f828 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:09.913468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1e042-f636-4036-934a-405ec4e0f828 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:09.913984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1e042-f636-4036-934a-405ec4e0f828 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:09.914899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1e042-f636-4036-934a-405ec4e0f828 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:09.916604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1e042-f636-4036-934a-405ec4e0f828 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:10.009057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 371/729] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:50:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:10.032765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d099a-e165-4a12-938d-59c2d1278b6a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:10.038809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d099a-e165-4a12-938d-59c2d1278b6a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:10.038809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d099a-e165-4a12-938d-59c2d1278b6a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:10.038809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 359/730] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:10.041066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc536c-7d5d-4c70-bffd-45bd803ba53b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:10.041575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc536c-7d5d-4c70-bffd-45bd803ba53b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:10.042131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc536c-7d5d-4c70-bffd-45bd803ba53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:10.064226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0bbc536c-7d5d-4c70-bffd-45bd803ba53b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:10.066062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0bbc536c-7d5d-4c70-bffd-45bd803ba53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:10.133700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:10.152429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 372/731] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:10.419251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d099a-e165-4a12-938d-59c2d1278b6a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:10.450147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:10.525983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d099a-e165-4a12-938d-59c2d1278b6a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:10.562033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1145142-973f-4490-8af8-4f8d30402e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:10.562638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145142-973f-4490-8af8-4f8d30402e4e None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:10.562911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145142-973f-4490-8af8-4f8d30402e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:10.563179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145142-973f-4490-8af8-4f8d30402e4e None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:10.563850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1145142-973f-4490-8af8-4f8d30402e4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:10.565258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1145142-973f-4490-8af8-4f8d30402e4e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:10.632519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 360/732] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:10 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:11.285866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9b75e-61cb-4713-8fcf-52327a6127b3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:11.286861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9b75e-61cb-4713-8fcf-52327a6127b3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:11.287354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9b75e-61cb-4713-8fcf-52327a6127b3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:11.289232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 373/733] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:11.295288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0173-476b-4240-9579-7234d515c17f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:11.296156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0173-476b-4240-9579-7234d515c17f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:11.296699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0173-476b-4240-9579-7234d515c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:11.316149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-63ec0173-476b-4240-9579-7234d515c17f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:11.317764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-63ec0173-476b-4240-9579-7234d515c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:11.382803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e077c63-be2f-4c3c-94bb-2b740ab87793 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:11.383252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e077c63-be2f-4c3c-94bb-2b740ab87793 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:11.383555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e077c63-be2f-4c3c-94bb-2b740ab87793 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:11.385571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 374/734] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:11.390527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:11.390813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:11.391090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:11.395965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 361/735] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:11.410781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:11.412267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:11.486987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 375/736] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:11.671014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0173-476b-4240-9579-7234d515c17f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:11.691189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:11.760227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:11.787007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0173-476b-4240-9579-7234d515c17f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:11.840152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:11.840816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:11.841095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:11.841364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:11.841948 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:11.843831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:11.856167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:11.857241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:11.858092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 362/737] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:11.863892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:11.876293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f359a-29bb-4c97-91b4-bb3b4b557ac9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:11.900781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:11.923760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:11.924450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:11.924740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:11.925016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:11.925686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:11.927783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:11.963285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:11.981541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99e96-7225-40fa-9b52-926f1e4151a1 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:12.020877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 376/738] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:11 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:12.027316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:12.027939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.028216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.028517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.029155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:12.029538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:12.031184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:12.042308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 363/739] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:12.044684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:12.160608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ee83b-390e-49bc-9b3d-58a78f9a84ac None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:12.200425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:12.201444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.201938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.202417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.203330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:12.204470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:12.206123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b272-1d22-49f8-ac9a-a8c109f820ab None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:12.212450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 377/740] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:12.222492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:12.320223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a37b-5470-498e-84e5-093f7d051ec0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.320801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a37b-5470-498e-84e5-093f7d051ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.320801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a37b-5470-498e-84e5-093f7d051ec0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.322254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 378/741] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:12.327579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.327871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.328148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.332179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07b0cb-9423-42fd-9cb7-26c2bd36a273 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:12.350116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:12.351633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:12.371123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:12.371734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.372012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.372283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.373030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] RBAC: Adding query filter params (interface=admin, service_id=db4f4bfc3d144691acd99c3da1835d7c, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:12.373336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:12.375136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:12.385874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 364/742] 10.222.0.13 () {56 vars in 1249 bytes} [Fri Oct 14 02:50:12 2022] GET /identity/v3/endpoints?service_id=db4f4bfc3d144691acd99c3da1835d7c&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:12.387530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:12.397242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:12.401485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:12.444526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 379/743] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:12.498690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e8249-aca0-4d0e-ac16-b37eab6ee79a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:12.532878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a1d0a-67d2-4649-94c6-2de80d024f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:12.533542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1d0a-67d2-4649-94c6-2de80d024f97 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.533817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1d0a-67d2-4649-94c6-2de80d024f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.534087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a1d0a-67d2-4649-94c6-2de80d024f97 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.534733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a1d0a-67d2-4649-94c6-2de80d024f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:12.536089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a1d0a-67d2-4649-94c6-2de80d024f97 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:12.548126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 365/744] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:50:12 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 02:50:12.716580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:12.824717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784d1b-71b7-467e-b426-208730cefae3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:12.855419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec54484-f488-4ebf-a608-ec1bf8714030 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.855615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec54484-f488-4ebf-a608-ec1bf8714030 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.855895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec54484-f488-4ebf-a608-ec1bf8714030 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.857538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 366/745] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:12.862492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:12.863042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.863330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.863611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.864075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:12.864610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:12.865081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:12.865917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:12.867855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:12.871051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING keystone.server.flask.common [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 14 02:50:12.882117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:12.883603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:12.916114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.sql.core [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 02:50:12.916114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 02:50:12.916114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [parameters: {'id': '516249da4df14b25a40431f834f0ad45', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 02:50:12.916114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 516249da4df14b25a40431f834f0ad45.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 516249da4df14b25a40431f834f0ad45. Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:50:12.927165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 02:50:12.928041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application yield resource Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise self.value Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application session.commit() Oct 14 02:50:12.929029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.flush() Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application compat.raise_( Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 02:50:12.929961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 02:50:12.930905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:50:12.931737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [parameters: {'id': '516249da4df14b25a40431f834f0ad45', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:12.934197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:12.936065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 516249da4df14b25a40431f834f0ad45. Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 380/746] 10.222.0.13 () {60 vars in 1140 bytes} [Fri Oct 14 02:50:12 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:12.938301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:12.965633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:12.987118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:12.998243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 367/747] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:13.043989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9cb5c-ffa0-4e7a-8d47-3a97a4fb6b0c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:13.078962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:13.079525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:13.079804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:13.080077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:13.087016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:13.088674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:50:13.102892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:13.103818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:13.104758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 381/748] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:13.110822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:13.210595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1fe05-2bc1-40d7-a28f-c834749b0473 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:13.246026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:13.246636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:13.246915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:13.247191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:13.247855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:13.248161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:13.249629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:13.268151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 368/749] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:13.314661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:13.413786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:13.426825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981148-4735-4080-a0da-dd2004c0dfa6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:13.465875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:13.466516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:13.466798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:13.467069 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:13.467653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:13.471224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:13.482724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:13.483790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:13.484702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 382/750] 10.222.0.13 () {56 vars in 1105 bytes} [Fri Oct 14 02:50:13 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:13.492599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:13.557502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:13.600071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d5cd-df1b-4677-9b28-dcf55dfd28fb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:13.638592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:13.639510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:13.640000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:13.640507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:13.641893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] RBAC: Adding query filter params (name=image) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:13.642428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:13.644021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:13.649602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 369/751] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:13.660458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:13.775918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500785-9bb7-40df-b4aa-a364fc11eaf3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:13.810899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:13.811573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:13.811859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:13.812135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:13.812795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] RBAC: Adding query filter params (type=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:13.813644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:13.815020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:13.823451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 383/752] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:13.830060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:13.942875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0171c-a129-4c0c-9616-c9c4ca796424 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:13.967645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:13.979213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:13.979828 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:13.980150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:13.993137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:13.993137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] RBAC: Adding query filter params (interface=public, service_id=ed508af2c895479b94e0e624bf11ab0a, region_id=RegionOne) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:13.993137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:13.993137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a2147-8512-44fd-b29a-06172fac6658 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:13.993137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 370/753] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:50:13 2022] GET /identity/v3/endpoints?service_id=ed508af2c895479b94e0e624bf11ab0a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:13.994966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:14.016508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:14.100244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab8d97-a544-453c-ac63-a3c9f91ef798 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:14.135970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f6b3c-8273-43f4-9f19-92d141f33b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:14.136679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6b3c-8273-43f4-9f19-92d141f33b20 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:14.137220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6b3c-8273-43f4-9f19-92d141f33b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:14.137499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f6b3c-8273-43f4-9f19-92d141f33b20 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:14.138114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f6b3c-8273-43f4-9f19-92d141f33b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:14.139536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f6b3c-8273-43f4-9f19-92d141f33b20 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:14.146735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 384/754] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:50:13 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 02:50:14.348255 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eb33-edea-42a1-bd8b-778a3b2ddc0c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:14.348572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eb33-edea-42a1-bd8b-778a3b2ddc0c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:14.348862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567eb33-edea-42a1-bd8b-778a3b2ddc0c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:14.350447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 371/755] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:14.355792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf191-b183-4639-96d1-061a248ff41c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:14.356083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf191-b183-4639-96d1-061a248ff41c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:14.356362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf191-b183-4639-96d1-061a248ff41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:14.375359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cbeaf191-b183-4639-96d1-061a248ff41c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:14.376927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cbeaf191-b183-4639-96d1-061a248ff41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:14.446466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 385/756] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:14 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:14.715481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eb33-edea-42a1-bd8b-778a3b2ddc0c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:14.795872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786379a-52ad-4457-930d-2d9d44ccc205 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:14.796199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786379a-52ad-4457-930d-2d9d44ccc205 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:14.796450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786379a-52ad-4457-930d-2d9d44ccc205 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:14.799124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 386/757] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:14.803059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:14.803343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:14.803611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:14.822290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:14.823467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:14.825839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567eb33-edea-42a1-bd8b-778a3b2ddc0c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:14.826443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:14.870851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:14.871485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:14.871865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:14.872464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:14.873075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:14.874795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:14.886348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:14.887623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:14.889052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 372/758] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:14.894106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:14.909636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 387/759] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:14 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:14.955367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:15.005171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a4a57-6099-47a9-b334-8e1eeb45474c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.041065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.042010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.042497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.042971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.043828 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:15.044332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.045934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.051681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 373/760] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:15.061150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.167098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173b7f4-bd12-428e-9d78-747e40050405 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.181413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.207187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.208187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.208702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.209218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.210110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:15.210628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.212302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.218878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 388/761] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:15.225419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.230070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:15.351415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da54098-0f16-4772-bd23-347fb4ce89c2 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.389093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.389706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.389983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.390252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.391012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] RBAC: Adding query filter params (interface=public, service_id=c0c05b88b2fa41ccb361a21d65c46d87, region_id=RegionOne) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:15.391842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.393248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.398830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 389/762] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:50:15 2022] GET /identity/v3/endpoints?service_id=c0c05b88b2fa41ccb361a21d65c46d87&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:15.403985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.431838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf07db0-5ef1-40f5-9de3-41da27e6396b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.449909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:15.469776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.470746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.471278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.471709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.472469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.474000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.476153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:15.485817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:15.490786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 14 02:50:15.492983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:15.494530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 374/763] 10.222.0.13 () {56 vars in 1126 bytes} [Fri Oct 14 02:50:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:50:15.504577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.524690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee352f2-e253-4e15-a681-fe9e9ca77f55 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.572532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.573218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.573497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.573770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.574439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.576332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.588462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 390/764] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:50:15 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 02:50:15.632970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c8fa-446f-49d5-9e5e-37fa99e00bf6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.670731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.671362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.671642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.671911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.673129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:15.673436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.674837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f4e21-36aa-43b4-a99d-132deaec0479 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.680928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 375/765] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:15.686646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.690935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85da57-e4da-41ba-b26a-14e91a86baba None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.691229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85da57-e4da-41ba-b26a-14e91a86baba None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.691501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85da57-e4da-41ba-b26a-14e91a86baba None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.693460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 376/766] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:15.699392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.699580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.699812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.718762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:15.720087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:15.769495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:15.806774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 377/767] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:15.816190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8ee25-6b29-43bf-8e63-fd568e46bebc None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:15.850110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:15.855211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:15.855818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:15.856095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:15.856363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:15.858600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:15.858600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:15.858901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:15.868499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 391/768] 10.222.0.13 () {56 vars in 1122 bytes} [Fri Oct 14 02:50:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:15.870449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:15.984249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b7a9f-7136-458f-8860-a4cec524fe4b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:16.020690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:16.021664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.022148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.022637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.023519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:16.025304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:16.081103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:16.093371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 378/769] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:50:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:16.196178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f2e2-bd4b-4d69-a046-c2e5d22b563b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:16.251879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:16.252502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.252799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.253082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.253787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:16.255527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:16.315998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.sql.core [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 02:50:16.315998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 02:50:16.315998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [parameters: {'user_id': '5de1199862e542efb03f8b38390a1df6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 02:50:16.315998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-2ae597ab-2560-46a0-9af7-8fec2cf95f92 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:50:16.323443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:50:16.324365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application yield resource Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise self.value Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application session.commit() Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 02:50:16.325699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.session.flush() Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application compat.raise_( Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 02:50:16.326759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:50:16.327708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application result.read() Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:50:16.330129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [parameters: {'user_id': '5de1199862e542efb03f8b38390a1df6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:16.332403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 14 02:50:16.334334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:16.336773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 392/770] 10.222.0.13 () {60 vars in 1131 bytes} [Fri Oct 14 02:50:16 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:50:16.338823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:16.370142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:16.387383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750ae7-6bd4-4741-b701-24c569727fbe None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.387702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750ae7-6bd4-4741-b701-24c569727fbe None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.388005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750ae7-6bd4-4741-b701-24c569727fbe None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.393121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 393/771] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:16.399271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.399558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.399840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.422530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:16.424225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:16.446608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7b22a-7319-470a-b208-e5b453561fc8 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:16.486412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:16.494092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:16.499200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.499200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.499200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.504555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 394/772] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:16.509663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:16.511210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:50:16.525219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:16.527628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:16.528965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 379/773] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:50:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:16.533086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:16.639264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24762ee-7dd2-4804-9f12-de7bdd5d6c92 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:16.685225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:16.685910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.686125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.686459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.687161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:16.687463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:16.689604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:16.724665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 395/774] 10.222.0.13 () {56 vars in 1101 bytes} [Fri Oct 14 02:50:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:16.784662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:16.894014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:16.901071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae457-a1de-4cde-a526-da9de19bd977 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:16.935480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:16.936123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:16.936413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:16.936716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] PATH_INFO: `/v3/services/image` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:16.937322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:16.939260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:16.949484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:16.951717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:16.954378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 380/775] 10.222.0.13 () {56 vars in 1105 bytes} [Fri Oct 14 02:50:16 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:16.958005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:17.006923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:17.065445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902629-2ca5-4d41-b98f-9efcc9030825 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:17.101010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:17.101622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:17.101903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:17.102180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:17.102810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] RBAC: Adding query filter params (name=image) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:17.103141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:17.104545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:17.114535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 396/776] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:17.116010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:17.217218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ffc3-c2bf-41cd-b5f4-f2987e165e3e None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:17.249940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:17.250561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:17.250843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:17.251117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:17.251740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] RBAC: Adding query filter params (type=image) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:17.252044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:17.253432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f09c0-e614-4c5a-bc50-f118feb85bef None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:17.258306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 381/777] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:17.263911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:17.361914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed5ff6-4f29-4b1e-9fc0-f6358691045b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:17.369089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:17.397481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71848986-fcca-4395-a0cd-bd614ede41b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:17.398116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71848986-fcca-4395-a0cd-bd614ede41b0 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:17.398399 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71848986-fcca-4395-a0cd-bd614ede41b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:17.398673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71848986-fcca-4395-a0cd-bd614ede41b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:17.399346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71848986-fcca-4395-a0cd-bd614ede41b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:17.400733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71848986-fcca-4395-a0cd-bd614ede41b0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:17.482700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 397/778] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:50:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:17.909565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee33771-94dc-4bb4-80dc-09183890853e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:17.910111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee33771-94dc-4bb4-80dc-09183890853e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:17.910111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee33771-94dc-4bb4-80dc-09183890853e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:17.911582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 382/779] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:17.916599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f858702-7a4f-4d03-ad43-699f4d440b81 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:17.916979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f858702-7a4f-4d03-ad43-699f4d440b81 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:17.917160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f858702-7a4f-4d03-ad43-699f4d440b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:17.936007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9f858702-7a4f-4d03-ad43-699f4d440b81 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:17.937168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9f858702-7a4f-4d03-ad43-699f4d440b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:18.020174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 398/780] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:17 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:18.290223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee33771-94dc-4bb4-80dc-09183890853e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:18.315025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:18.342957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c66e1-e498-4850-a9b0-58547daedbd0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.343255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c66e1-e498-4850-a9b0-58547daedbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.343521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c66e1-e498-4850-a9b0-58547daedbd0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.345431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 399/781] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:18.350456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.350740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.351019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.369154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:18.370326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:18.395038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee33771-94dc-4bb4-80dc-09183890853e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:18.432808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:18.433432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.433708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.433978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.434553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:18.435905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:18.443570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 400/782] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:18 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:18.444649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:18.445620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:18.446500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 383/783] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:18.454689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:18.473357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:18.553257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f1553-4c63-4e25-8fab-aa56d2f0203f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:18.585951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:18.586546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.586821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.587087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.587703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:18.588002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:18.589374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:18.594879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 401/784] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:18.600378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:18.691178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:18.705761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf09ac2-78dd-42e3-a1c9-03a891f63d6f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:18.713433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:18.740305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:18.741013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.741293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.741568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.742198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:18.742499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:18.743859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:18.748789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 384/785] 10.222.0.13 () {56 vars in 1112 bytes} [Fri Oct 14 02:50:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:18.754375 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:18.806695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:18.827323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba80ec-1ca4-4880-bb2e-d28e583829ae None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:18.858748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682e399-abdc-45b5-a6df-9970d143739c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:18.867050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:18.867679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.868171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.868280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.869486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:18.870864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:18.872969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 402/786] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:18.878688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:18.898721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42754833-437c-47df-829a-d65a3f4edc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:18.899320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754833-437c-47df-829a-d65a3f4edc62 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:18.899601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754833-437c-47df-829a-d65a3f4edc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:18.899875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42754833-437c-47df-829a-d65a3f4edc62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:18.900980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754833-437c-47df-829a-d65a3f4edc62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:18.902347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42754833-437c-47df-829a-d65a3f4edc62 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:18.976588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6765f51-c186-4b05-8a77-97b1fd60d338 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:18.985397 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 385/787] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:50:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:19.020223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ca6d3-4f4a-4cbe-b9be-1b778f130ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:19.020883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ca6d3-4f4a-4cbe-b9be-1b778f130ac3 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:19.021168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ca6d3-4f4a-4cbe-b9be-1b778f130ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:19.021441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ca6d3-4f4a-4cbe-b9be-1b778f130ac3 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:19.022102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ca6d3-4f4a-4cbe-b9be-1b778f130ac3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:19.023699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ca6d3-4f4a-4cbe-b9be-1b778f130ac3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:19.104555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:19.112703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 403/788] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:18 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:19.681988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a2d4-6507-4205-bdfd-7deccf384aff None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:19.682270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a2d4-6507-4205-bdfd-7deccf384aff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:19.682537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0a2d4-6507-4205-bdfd-7deccf384aff None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:19.683910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 386/789] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:19.689083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:19.689377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:19.689658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:19.707463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:19.708681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:19.775826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 404/790] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:20.047997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a2d4-6507-4205-bdfd-7deccf384aff None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:20.057690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:20.148813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0a2d4-6507-4205-bdfd-7deccf384aff None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:20.182115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:20.182966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:20.183398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:20.183819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:20.184658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:20.186156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:20.224306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.sql.core [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 02:50:20.224306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 02:50:20.224306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [parameters: {'id': '73e842732a3a41b09a803b3d09dcd79c', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 02:50:20.224306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81513) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:50:20.241497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result.read() Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 14 02:50:20.242367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application yield resource Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application next(self.gen) Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.session.rollback() Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.force_reraise() Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise self.value Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application session.commit() Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 14 02:50:20.244455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._prepare_impl() Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.session.flush() Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._flush(objects) Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application compat.raise_( Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application flush_context.execute() Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rec.execute(self) Oct 14 02:50:20.245339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 14 02:50:20.246241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result = self._query(query) Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application conn.query(q) Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application result.read() Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 14 02:50:20.247032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [parameters: {'id': '73e842732a3a41b09a803b3d09dcd79c', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 14 02:50:20.248563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:20.249351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:20.250233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 387/791] 10.222.0.13 () {60 vars in 1137 bytes} [Fri Oct 14 02:50:20 2022] POST /identity/v3/domains => generated 190 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:20.250934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:20.349174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3414eb5-e572-410d-a4b6-42675ca959bd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:20.375827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:20.384100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:20.384761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:20.387722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:20.387722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:20.396233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:20.397703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ae5a39e1-a484-4eeb-a2b2-2eefceddd455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:20.412407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:20.413355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:20.414260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:20.414260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:20.414260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:20.414260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 405/792] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:20.419605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:20.492695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:20.523764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23002ef-b1e9-4b50-9136-ed3836babc49 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:20.556189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:20.556827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:20.557109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:20.557384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:20.558025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:20.558328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:20.559696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83077645-1b26-4a0d-a33a-2b9145c2a7ed None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:20.572670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 388/793] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:21.253747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749644-9ec1-4f32-ac95-f4b996eed243 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.254309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749644-9ec1-4f32-ac95-f4b996eed243 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.254309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53749644-9ec1-4f32-ac95-f4b996eed243 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.255659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 406/794] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:21.260857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.261264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.261405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.272025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ceec-6496-42f5-85c2-a026f378be12 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.272330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ceec-6496-42f5-85c2-a026f378be12 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.272617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ceec-6496-42f5-85c2-a026f378be12 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.273910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 407/795] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:21.278954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.279241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.279517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.281730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:21.282921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:21.296911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:21.298065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:21.348112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 389/796] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:21.365063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 408/797] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:21.614438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:21.637141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:21.674206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:21.714450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c4ca9-55f8-4777-9714-63999bb47cd7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:21.734135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2d678-00ce-4f08-bf4d-557bb336f23b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:21.744961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:21.747268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:21.747897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.748179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.748481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.759442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:21.764450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:21.765593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:21.766682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 390/798] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:50:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:21.771040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:21.771523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:21.771687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.772211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.772809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.774240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:21.775767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:21.780012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 409/799] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:21.783004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:21.870393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b5a13-bad9-49cc-a49b-bed4bbbf6d1a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:21.883133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d3d70-6aed-428a-9359-4b9d6419069c None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:21.889658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:21.903107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:21.903709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.903991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.904268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.904955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:21.905265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:21.907153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:21.915348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 391/800] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Oct 14 02:50:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:21.917011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:21.917616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:21.917903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:21.918181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:21.918828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:21.920244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:21.920963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:22.000652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 410/801] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:50:21 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:22.028626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc00b60-612c-4516-bcb5-070ee20784fa None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:22.066387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:22.067033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:22.067318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:22.067592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:22.078615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:22.080101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:22.096453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:22.097610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:22.098512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:22.098512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:22.098512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:22.098512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 392/802] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:22.103625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:22.139928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:22.208293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f9e7-0a84-4737-baea-c23652dd86ce None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:22.241827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:22.242443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:22.242728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:22.243007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:22.243656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:22.243963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:22.245350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:22.256948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 411/803] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:22.262855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:22.296957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:22.363868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8c22e-cd9c-4c73-ad0c-9547dc3db07f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:22.398076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:22.398629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:22.398912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:22.399186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:22.406714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:22.408151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:50:22.419399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:22.420664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:22.422130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 393/804] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Oct 14 02:50:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:50:22.426388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:22.517310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:22.523742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cae03-ffa3-463c-b631-23ff3b753cdf None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:22.558050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:22.558659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:22.558941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:22.559216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:22.559938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:22.560244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:22.561694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:22.578736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 412/805] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Oct 14 02:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:22.584431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:22.677142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:22.683602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fb727-9372-4367-a1fe-3a71f93004bf None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:22.718302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:22.718931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:22.719212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:22.719487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:22.729328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:22.730789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:22.745596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:22.746540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:22.747438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:22.747438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:22.747438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:22.747438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 394/806] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:22.753183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:22.849792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11066a1d-e2e1-4c8c-b751-8af54539a0f4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:22.883532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:22.884134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:22.884439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:22.884718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:22.885364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:22.885668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:22.887293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:22.899077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 413/807] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:22.904990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:23.004028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5fa879-81f9-4a54-8f7e-d4943b1c062a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:23.036460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:23.037079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:23.037361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:23.037635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:23.044312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:23.045787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:50:23.057157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:23.058212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:23.059187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 395/808] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:23.065036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:23.079943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:23.162472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d2a2f-7cee-4902-bada-1127c66566b4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:23.196452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:23.197054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:23.197329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:23.197596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:23.198278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:23.198579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:23.200054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e868f-944b-45b7-a4e4-5d6d83e756c4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:23.211579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 414/809] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:23.217450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:23.226824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:23.316027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200d23f-75c7-4c89-96f4-709b30dc11ed None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:23.347951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46663a8b-3741-4ede-9b3c-a02336ae8842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:23.348617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663a8b-3741-4ede-9b3c-a02336ae8842 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:23.348895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663a8b-3741-4ede-9b3c-a02336ae8842 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:23.349166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663a8b-3741-4ede-9b3c-a02336ae8842 None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/3ec4a4200e034887a5e119c109dea1f4/roles/fe65d40770b64b989f3a5590a464cc45` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:23.351253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663a8b-3741-4ede-9b3c-a02336ae8842 None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=3ec4a4200e034887a5e119c109dea1f4, role_id=fe65d40770b64b989f3a5590a464cc45)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:23.352713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46663a8b-3741-4ede-9b3c-a02336ae8842 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:23.417848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 396/810] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:50:23 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/3ec4a4200e034887a5e119c109dea1f4/roles/fe65d40770b64b989f3a5590a464cc45 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:50:24.184283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74becb-71d5-4169-a5f9-348b012bda98 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:24.184901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74becb-71d5-4169-a5f9-348b012bda98 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:24.184901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74becb-71d5-4169-a5f9-348b012bda98 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:24.186336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 415/811] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:24.191483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:24.191770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:24.192047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:24.210242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:24.211409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:24.271217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:24.279250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 397/812] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:24.546732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74becb-71d5-4169-a5f9-348b012bda98 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:24.616666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:24.646239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74becb-71d5-4169-a5f9-348b012bda98 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:24.681318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:24.681949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:24.682230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:24.682504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:24.692367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:24.697266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:24.698484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:24.699622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:24.703700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 416/813] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:50:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:24.705079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:24.799813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d739-0e61-48e1-a362-fc1e5e40ad0c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:24.832483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:24.833085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:24.833366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:24.833637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:24.834294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:24.834598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:24.835957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:24.844321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 398/814] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:24.850047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:24.946536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb88a7c-8280-4afa-940c-7ae863ab4c44 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:24.975107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:24.979957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:24.980613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:24.980897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:24.981170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] PATH_INFO: `/v3/users/5a90ad021d73469c974c445fbe8d7b91` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:24.993839 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] RBAC: Authorizing `identity:get_user(user_id=5a90ad021d73469c974c445fbe8d7b91)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:24.995266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:24.996981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 417/815] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:24 2022] GET /identity/v3/users/5a90ad021d73469c974c445fbe8d7b91 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:25.003177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:25.061467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:25.102231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03aa87-b247-4869-9622-366fbd0427dc None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:25.134639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce26eb-546e-4448-9170-2dbb1e85ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:25.135267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce26eb-546e-4448-9170-2dbb1e85ac69 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:25.135550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce26eb-546e-4448-9170-2dbb1e85ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:25.135827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce26eb-546e-4448-9170-2dbb1e85ac69 None admin] PATH_INFO: `/v3/projects/11210259367946638fe0e425aee3aa6a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:25.137221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce26eb-546e-4448-9170-2dbb1e85ac69 None admin] RBAC: Authorizing `identity:get_project(project_id=11210259367946638fe0e425aee3aa6a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:25.138649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce26eb-546e-4448-9170-2dbb1e85ac69 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:25.141002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 399/816] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:50:25 2022] GET /identity/v3/projects/11210259367946638fe0e425aee3aa6a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:25.146832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:25.244378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c961d4-449b-4182-ad0b-89d6fcc00072 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:25.277345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf35e-3466-4c50-ab05-1ddb26fe07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:25.277994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf35e-3466-4c50-ab05-1ddb26fe07bb None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:25.278277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf35e-3466-4c50-ab05-1ddb26fe07bb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:25.278549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf35e-3466-4c50-ab05-1ddb26fe07bb None admin] PATH_INFO: `/v3/projects/11210259367946638fe0e425aee3aa6a/users/5a90ad021d73469c974c445fbe8d7b91/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:25.280440 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bf35e-3466-4c50-ab05-1ddb26fe07bb None admin] RBAC: Authorizing `identity:create_grant(project_id=11210259367946638fe0e425aee3aa6a, user_id=5a90ad021d73469c974c445fbe8d7b91, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:25.282603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bf35e-3466-4c50-ab05-1ddb26fe07bb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:25.348716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 418/817] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:50:25 2022] PUT /identity/v3/projects/11210259367946638fe0e425aee3aa6a/users/5a90ad021d73469c974c445fbe8d7b91/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:50:25.548594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c8bb-dfb3-4128-b583-595e79f299fd None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:25.548881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c8bb-dfb3-4128-b583-595e79f299fd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:25.549160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c8bb-dfb3-4128-b583-595e79f299fd None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:25.550506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 400/818] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:25.556014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:25.556301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:25.556600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:25.575091 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:25.576258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:25.735924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:25.756690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 419/819] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:26.026303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66c8bb-dfb3-4128-b583-595e79f299fd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:26.125994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66c8bb-dfb3-4128-b583-595e79f299fd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:26.151022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:26.159727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361932-270c-456e-8840-ab068542aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:26.165456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361932-270c-456e-8840-ab068542aa37 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:26.165456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361932-270c-456e-8840-ab068542aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:26.165456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361932-270c-456e-8840-ab068542aa37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:26.171097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39361932-270c-456e-8840-ab068542aa37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-39361932-270c-456e-8840-ab068542aa37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:26.175807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:26.176831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:26.177665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 401/820] 10.222.0.13 () {56 vars in 1120 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:26.183028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:26.284568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056345ed-dbaa-4e31-95be-839356cdd3e9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:26.316963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:26.317571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:26.317851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:26.318123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:26.318780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:26.319083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:26.320455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:26.328633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 420/821] 10.222.0.13 () {56 vars in 1115 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:26.334466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361932-270c-456e-8840-ab068542aa37 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:26.430304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361932-270c-456e-8840-ab068542aa37 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:26.463996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:26.464650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:26.464931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:26.465203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:26.474927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:26.476373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:26.491162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:26.492282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:26.493486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:26.493486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:26.493486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:26.493486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 402/822] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:26.498015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:26.540619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:26.595728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49098f0e-112f-4883-a879-fdd02a0d90e0 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:26.628094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:26.628734 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:26.629018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:26.629291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:26.629928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:26.630234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:26.631586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:26.643754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 421/823] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:26.649391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:26.691141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:26.748906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e050f-d646-43ea-ba68-a9d62d58b055 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:26.781625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:26.782249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:26.782528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:26.782799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:26.789446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:26.790916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:50:26.802459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:26.803411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:26.804735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 403/824] 10.222.0.13 () {56 vars in 1093 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:26.809282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:26.905138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c7857-6d1f-4158-b3ab-035068b0a18b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:26.906664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:26.939311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:26.939909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:26.940186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:26.940494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:26.941212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:26.941514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:26.943092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:26.960185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 422/825] 10.222.0.13 () {56 vars in 1133 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:26.965754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.061191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:27.065383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d6793-8b06-4313-847d-b62680404ee5 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:27.098889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:27.099494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.099777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.100051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.165647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:27.167091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:27.258354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:27.262798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 404/826] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:50:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:50:27.268659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.368259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef0c4f-28a1-49ea-885d-2059f3db45e6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:27.403001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:27.403623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.403901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.404173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.414334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:27.415754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-fef2b3e0-800f-407d-9d1d-f8e8c0508892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:50:27.430910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:27.432052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:50:27.433022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:50:27.433022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:50:27.433022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:27.433022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 423/827] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:27.437786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.472558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ebce9-f02c-4b02-968e-1eaab91884e4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.472939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ebce9-f02c-4b02-968e-1eaab91884e4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.473214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ebce9-f02c-4b02-968e-1eaab91884e4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.474526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 424/828] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:50:27.479432 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.479715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.479991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.497552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:27.498723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:27.505821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:27.536784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ce476-26df-401f-a626-54510b31396c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:27.566247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 425/829] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:27.571906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:27.572535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.572817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.573087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.573727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:27.574030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:27.575391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:27.587073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 405/830] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:27.592760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.688856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c292855-2d68-46ea-99f5-1f2807b37d8c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:27.721603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:27.722216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.722488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.722754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.729045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:27.730466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:50:27.741101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:27.742137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:27.743126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 426/831] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:50:27.747974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.804340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:27.835935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.838770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:27.845600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892844-9883-4eb1-9b7f-dbb520bec357 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:27.879810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:27.880439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.880722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.880995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.881679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:27.881983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:27.883403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:27.896128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 406/832] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:27.902102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:27.939123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6b736-cc97-426a-ac0e-d3de48ecd291 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:27.971305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:27.971931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:27.972202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:27.972502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:27.982643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:27.987261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:27.988252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:27.989389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 427/833] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:50:27.994174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:28.000321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33c9fc-10b5-49f8-880e-c35fcd768c05 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:28.018530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:28.037128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:28.037826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:28.038110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:28.038384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:28.039123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] RBAC: Adding query filter params (role.id=fe65d40770b64b989f3a5590a464cc45, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=3ec4a4200e034887a5e119c109dea1f4) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:28.039442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:28.041588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:28.048076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 407/834] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/role_assignments?user.id=3ec4a4200e034887a5e119c109dea1f4&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=fe65d40770b64b989f3a5590a464cc45 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:28.055154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:28.097454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661b317-4316-46cb-93e1-0426a7984631 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:28.132664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:28.133271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:28.133547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:28.133814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:28.134488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:28.134790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:28.136164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:28.146160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 428/835] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:50:28.151985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:28.258031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f50b1-863b-4e1e-9cfd-b53697cdb9bb None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:28.290770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:28.291396 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:28.291677 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:28.291951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] PATH_INFO: `/v3/users/5a90ad021d73469c974c445fbe8d7b91` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:28.293094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] RBAC: Authorizing `identity:get_user(user_id=5a90ad021d73469c974c445fbe8d7b91)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:28.294535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:28.296110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 408/836] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:28 2022] GET /identity/v3/users/5a90ad021d73469c974c445fbe8d7b91 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:28.302490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:28.404782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5631a-3aaf-413f-8cad-98b575787005 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:28.428382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:28.439504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:28.440110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:28.440935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:28.440935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:28.506815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:28.508296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:28.606794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 429/837] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:50:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:50:28.613665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:28.666234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:28.717077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed0d8c-18aa-45ee-92b5-0436ee952784 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:28.751556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c07dd-961b-4444-9a60-6bb7e3fb5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:28.752178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c07dd-961b-4444-9a60-6bb7e3fb5c98 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:28.752482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c07dd-961b-4444-9a60-6bb7e3fb5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:28.752754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c07dd-961b-4444-9a60-6bb7e3fb5c98 None admin] PATH_INFO: `/v3/projects/11210259367946638fe0e425aee3aa6a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:28.753854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c07dd-961b-4444-9a60-6bb7e3fb5c98 None admin] RBAC: Authorizing `identity:get_project(project_id=11210259367946638fe0e425aee3aa6a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:28.755276 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c07dd-961b-4444-9a60-6bb7e3fb5c98 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:28.757335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 409/838] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:50:28 2022] GET /identity/v3/projects/11210259367946638fe0e425aee3aa6a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:28.763777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:28.791584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:28.866159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636a60-4e82-456a-a515-fc5e90c8566a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:28.899908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:28.900562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:28.900841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:28.901104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:28.901828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=11210259367946638fe0e425aee3aa6a, user.id=5a90ad021d73469c974c445fbe8d7b91) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:28.902137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:28.903558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960eb66-e965-4a14-b648-7392928d15a4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:28.909844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 430/839] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:50:28 2022] GET /identity/v3/role_assignments?user.id=5a90ad021d73469c974c445fbe8d7b91&scope.project.id=11210259367946638fe0e425aee3aa6a&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:31.043825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00218-2062-495e-82ef-76b9267359eb None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:31.044323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00218-2062-495e-82ef-76b9267359eb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:31.044323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00218-2062-495e-82ef-76b9267359eb None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:31.045663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 410/840] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:31.050902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:31.051305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:31.051443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:31.070378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:31.071543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:31.134014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 431/841] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:31.401454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00218-2062-495e-82ef-76b9267359eb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:31.499696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00218-2062-495e-82ef-76b9267359eb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:31.517117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:31.532969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9035c-b887-498a-ab95-42d4e3a290cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:31.533581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9035c-b887-498a-ab95-42d4e3a290cb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:31.533861 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9035c-b887-498a-ab95-42d4e3a290cb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:31.534134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9035c-b887-498a-ab95-42d4e3a290cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:31.535233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9035c-b887-498a-ab95-42d4e3a290cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:31.536728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9035c-b887-498a-ab95-42d4e3a290cb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:31.538262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 411/842] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:31.543833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:31.562352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:31.639723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b1ce-80ab-487b-836d-0bae65f4cb62 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:31.672845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04866268-3bb7-4669-8135-8a588268c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:31.673388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04866268-3bb7-4669-8135-8a588268c808 None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:31.673991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04866268-3bb7-4669-8135-8a588268c808 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:31.673991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04866268-3bb7-4669-8135-8a588268c808 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:31.674561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04866268-3bb7-4669-8135-8a588268c808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:31.675982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04866268-3bb7-4669-8135-8a588268c808 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:31.782230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 432/843] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:50:31 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:33.922646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea462-ce77-4d14-9ed2-eef1bc87be34 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:33.923228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea462-ce77-4d14-9ed2-eef1bc87be34 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:33.923228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ea462-ce77-4d14-9ed2-eef1bc87be34 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:33.924578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 412/844] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:33.929649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:33.930055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:33.930191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:33.948477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:33.949649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:34.012590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 433/845] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:34.279266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ea462-ce77-4d14-9ed2-eef1bc87be34 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:34.374900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ea462-ce77-4d14-9ed2-eef1bc87be34 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:34.407717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:34.408323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:34.408626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:34.408898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] PATH_INFO: `/v3/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:34.410258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] RBAC: Authorizing `identity:get_role(role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:34.411602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:34.412922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 413/846] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:34 2022] GET /identity/v3/roles/6758e63c58de49968859f2dd43ea8a24 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:34.418613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:34.422191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:34.513992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65d840-56fd-4355-996f-729000f30a14 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:34.546804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:34.547365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:34.547643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:34.547915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] PATH_INFO: `/v3/users/39bc8d9eb784480886eda3e4a5a3e683` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:34.560110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=39bc8d9eb784480886eda3e4a5a3e683)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:34.561628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:34.563234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 434/847] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:34 2022] GET /identity/v3/users/39bc8d9eb784480886eda3e4a5a3e683 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:34.568986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:34.622077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:34.666241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043060ae-ef30-4a20-b580-4351c996ef3c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:34.699157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523fffc-94d8-41ca-9dae-d7f1ab80b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:34.699778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523fffc-94d8-41ca-9dae-d7f1ab80b640 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:34.700058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523fffc-94d8-41ca-9dae-d7f1ab80b640 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:34.700329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523fffc-94d8-41ca-9dae-d7f1ab80b640 None admin] PATH_INFO: `/v3/projects/11210259367946638fe0e425aee3aa6a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:34.701460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523fffc-94d8-41ca-9dae-d7f1ab80b640 None admin] RBAC: Authorizing `identity:get_project(project_id=11210259367946638fe0e425aee3aa6a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:34.703514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523fffc-94d8-41ca-9dae-d7f1ab80b640 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:34.705157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 414/848] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:50:34 2022] GET /identity/v3/projects/11210259367946638fe0e425aee3aa6a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:34.711048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:34.769599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:34.806123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a36cd8-270b-40f8-aa08-86f765bef3f4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:34.838949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452b21-b616-462c-b7d3-dee77a8d77eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:34.839593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452b21-b616-462c-b7d3-dee77a8d77eb None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:34.839874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452b21-b616-462c-b7d3-dee77a8d77eb None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:34.840144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452b21-b616-462c-b7d3-dee77a8d77eb None admin] PATH_INFO: `/v3/projects/11210259367946638fe0e425aee3aa6a/users/39bc8d9eb784480886eda3e4a5a3e683/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:34.842277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452b21-b616-462c-b7d3-dee77a8d77eb None admin] RBAC: Authorizing `identity:create_grant(project_id=11210259367946638fe0e425aee3aa6a, user_id=39bc8d9eb784480886eda3e4a5a3e683, role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:34.843727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452b21-b616-462c-b7d3-dee77a8d77eb None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:34.937195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 435/849] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:50:34 2022] PUT /identity/v3/projects/11210259367946638fe0e425aee3aa6a/users/39bc8d9eb784480886eda3e4a5a3e683/roles/6758e63c58de49968859f2dd43ea8a24 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:50:37.036354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ee1f-10da-4118-8abc-d50d1b994ee1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:37.036900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ee1f-10da-4118-8abc-d50d1b994ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:37.036900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ee1f-10da-4118-8abc-d50d1b994ee1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:37.038228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 415/850] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:37.043468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:37.043888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:37.043995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:37.062112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:37.063278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:37.128855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 436/851] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:37.397830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ee1f-10da-4118-8abc-d50d1b994ee1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:37.496042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ee1f-10da-4118-8abc-d50d1b994ee1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:37.518434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:37.529388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:37.530027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:37.530311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:37.530599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] PATH_INFO: `/v3/roles/6758e63c58de49968859f2dd43ea8a24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:37.531962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] RBAC: Authorizing `identity:get_role(role_id=6758e63c58de49968859f2dd43ea8a24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:37.533367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:37.534674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 416/852] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:37 2022] GET /identity/v3/roles/6758e63c58de49968859f2dd43ea8a24 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:37.540783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:37.590745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:37.635696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb215-daae-406f-8381-e13cd85e9a1a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:37.674292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:37.674926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:37.675207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:37.675478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] PATH_INFO: `/v3/users/39bc8d9eb784480886eda3e4a5a3e683` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:37.676611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] RBAC: Authorizing `identity:get_user(user_id=39bc8d9eb784480886eda3e4a5a3e683)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:37.678031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:37.679593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 437/853] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:37 2022] GET /identity/v3/users/39bc8d9eb784480886eda3e4a5a3e683 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:37.685360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:37.781329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9decb96-0c7d-4614-98c4-97b87bd2f635 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:37.813559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:37.814153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:37.814437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:37.814711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:37.869349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:37.879128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:37.880600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:37.976230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 417/854] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:50:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:50:37.982077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:38.075247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0533f-a423-4dcc-8f9e-09545ef75be4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:38.094803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:38.107673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557b116-a2ed-4fb4-ba57-cdeecb467e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:38.109373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b116-a2ed-4fb4-ba57-cdeecb467e63 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:38.109373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b116-a2ed-4fb4-ba57-cdeecb467e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:38.109373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b116-a2ed-4fb4-ba57-cdeecb467e63 None admin] PATH_INFO: `/v3/projects/11210259367946638fe0e425aee3aa6a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:38.113955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b116-a2ed-4fb4-ba57-cdeecb467e63 None admin] RBAC: Authorizing `identity:get_project(project_id=11210259367946638fe0e425aee3aa6a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:38.113955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b116-a2ed-4fb4-ba57-cdeecb467e63 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:38.113955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 438/855] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:50:37 2022] GET /identity/v3/projects/11210259367946638fe0e425aee3aa6a => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:38.119724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:38.205884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:38.215229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c53c79-59b6-4830-98cf-0cd9f3336b72 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:38.248738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:38.249279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:38.249562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:38.249835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:38.250549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] RBAC: Adding query filter params (role.id=6758e63c58de49968859f2dd43ea8a24, scope.project.id=11210259367946638fe0e425aee3aa6a, user.id=39bc8d9eb784480886eda3e4a5a3e683) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:38.250856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:38.252273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b674-91c1-4f23-97fd-582837e276c1 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:38.257840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 418/856] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:50:38 2022] GET /identity/v3/role_assignments?user.id=39bc8d9eb784480886eda3e4a5a3e683&scope.project.id=11210259367946638fe0e425aee3aa6a&role.id=6758e63c58de49968859f2dd43ea8a24 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:40.359947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f16374-5550-47a4-80ac-2a5829b6472e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:40.360498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f16374-5550-47a4-80ac-2a5829b6472e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:40.360590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f16374-5550-47a4-80ac-2a5829b6472e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:40.361870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 439/857] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:40.367062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:40.367491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:40.367610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:40.385982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:40.387147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:40.449678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 419/858] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:40.712169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f16374-5550-47a4-80ac-2a5829b6472e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:40.809336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f16374-5550-47a4-80ac-2a5829b6472e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:40.842516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04ecec-447d-4481-bfd1-652a458db786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:40.843119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04ecec-447d-4481-bfd1-652a458db786 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:40.843400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04ecec-447d-4481-bfd1-652a458db786 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:40.843668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04ecec-447d-4481-bfd1-652a458db786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:40.844779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04ecec-447d-4481-bfd1-652a458db786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:40.846190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04ecec-447d-4481-bfd1-652a458db786 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:40.847721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 440/859] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:40.853309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:40.933058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:40.948299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12da70b-bc44-46df-b0b6-4b2986773924 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:40.981524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edb6c2-7e97-4ace-b2d1-9fca4b3ebb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:40.982117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb6c2-7e97-4ace-b2d1-9fca4b3ebb1f None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:40.982403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb6c2-7e97-4ace-b2d1-9fca4b3ebb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:40.983209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edb6c2-7e97-4ace-b2d1-9fca4b3ebb1f None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:40.983848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb6c2-7e97-4ace-b2d1-9fca4b3ebb1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:40.985299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edb6c2-7e97-4ace-b2d1-9fca4b3ebb1f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:41.073541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 420/860] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:40 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:43.211100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656d62-5fa7-4dc6-b337-61bb5edd6346 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:43.211625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656d62-5fa7-4dc6-b337-61bb5edd6346 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:43.211625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656d62-5fa7-4dc6-b337-61bb5edd6346 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:43.212986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 441/861] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:43.218295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:43.218693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:43.218847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:43.237141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:43.238318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:43.302200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 421/862] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 14 02:50:43.569076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656d62-5fa7-4dc6-b337-61bb5edd6346 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:43.624524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:43.666375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656d62-5fa7-4dc6-b337-61bb5edd6346 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:43.702243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb66a17-c993-4961-b2f8-95058f9c5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:43.702864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb66a17-c993-4961-b2f8-95058f9c5be2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:43.703141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb66a17-c993-4961-b2f8-95058f9c5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:43.703409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb66a17-c993-4961-b2f8-95058f9c5be2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:43.704542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb66a17-c993-4961-b2f8-95058f9c5be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:43.705968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb66a17-c993-4961-b2f8-95058f9c5be2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:43.707543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 442/863] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:43.713339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:43.775449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:43.808730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075a57d-6f2f-4bf9-984d-96d803dd03c9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:43.842450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e492f78-36ac-404f-bb8a-936817916602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:43.843037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e492f78-36ac-404f-bb8a-936817916602 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:43.843319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e492f78-36ac-404f-bb8a-936817916602 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:43.843591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e492f78-36ac-404f-bb8a-936817916602 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:43.844240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e492f78-36ac-404f-bb8a-936817916602 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:43.845694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e492f78-36ac-404f-bb8a-936817916602 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:43.970879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 422/864] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:50:43 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:46.105911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7c50-8e93-4342-af89-2a19adb933bb None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:46.106411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7c50-8e93-4342-af89-2a19adb933bb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:46.106501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7c50-8e93-4342-af89-2a19adb933bb None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:46.108411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 443/865] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:46.113501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:46.113911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:46.114055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:46.132288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:46.133485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:46.203152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 423/866] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:46.468980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7c50-8e93-4342-af89-2a19adb933bb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:46.566562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7c50-8e93-4342-af89-2a19adb933bb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:46.589148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:46.599776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:46.600410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:46.604092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:46.604092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:46.610727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:46.615536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:46.616490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:46.617339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:50:46.618141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 444/867] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:50:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:46.623496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:46.674918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:46.720595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883b407-6c00-4c75-94bc-669a77762846 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:46.753263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:46.753853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:46.754128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:46.754392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:46.755039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:46.755337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:46.756721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:46.765148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 424/868] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:46.770914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:46.864301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791cbd-e758-4975-94fd-350a8ab591ec None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:46.896956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:46.897555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:46.897833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:46.898104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] PATH_INFO: `/v3/users/b77091e6bc544abb8e1297004175a9cc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:46.910310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] RBAC: Authorizing `identity:get_user(user_id=b77091e6bc544abb8e1297004175a9cc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:46.911714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:46.913279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 445/869] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:46 2022] GET /identity/v3/users/b77091e6bc544abb8e1297004175a9cc => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:46.918782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:47.015438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffa54d-438b-4af1-843b-90d3015db36d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:47.028302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:47.048126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775ce1e-ea71-446e-83c1-96a1a3f89f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:47.048775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ce1e-ea71-446e-83c1-96a1a3f89f31 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:47.049057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ce1e-ea71-446e-83c1-96a1a3f89f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:47.049425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775ce1e-ea71-446e-83c1-96a1a3f89f31 None admin] PATH_INFO: `/v3/projects/3fa9eaa5c0a2486ca43d3af9ec24c341` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:47.050901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775ce1e-ea71-446e-83c1-96a1a3f89f31 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9eaa5c0a2486ca43d3af9ec24c341)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:47.052674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775ce1e-ea71-446e-83c1-96a1a3f89f31 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:47.054315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 425/870] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:50:46 2022] GET /identity/v3/projects/3fa9eaa5c0a2486ca43d3af9ec24c341 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:47.060055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:47.101714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:47.156187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad566e94-4c3d-46ff-8a01-e28d6c8ef368 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:47.190828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e5b36-9615-47fb-92ab-4309ff51ffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:47.191471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e5b36-9615-47fb-92ab-4309ff51ffbd None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:47.191753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e5b36-9615-47fb-92ab-4309ff51ffbd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:47.192030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e5b36-9615-47fb-92ab-4309ff51ffbd None admin] PATH_INFO: `/v3/projects/3fa9eaa5c0a2486ca43d3af9ec24c341/users/b77091e6bc544abb8e1297004175a9cc/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:47.194038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e5b36-9615-47fb-92ab-4309ff51ffbd None admin] RBAC: Authorizing `identity:create_grant(project_id=3fa9eaa5c0a2486ca43d3af9ec24c341, user_id=b77091e6bc544abb8e1297004175a9cc, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:47.195496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e5b36-9615-47fb-92ab-4309ff51ffbd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:47.255527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 446/871] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:50:47 2022] PUT /identity/v3/projects/3fa9eaa5c0a2486ca43d3af9ec24c341/users/b77091e6bc544abb8e1297004175a9cc/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:50:49.339894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7686e5-6e2d-44a8-8a4e-bc3908507821 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:49.340589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7686e5-6e2d-44a8-8a4e-bc3908507821 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:49.340589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7686e5-6e2d-44a8-8a4e-bc3908507821 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:49.342367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 426/872] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:49.347591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:49.347961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:49.348145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:49.365819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:49.366987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:49.430940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 447/873] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:49.703132 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7686e5-6e2d-44a8-8a4e-bc3908507821 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:49.803069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7686e5-6e2d-44a8-8a4e-bc3908507821 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:49.835953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:49.836596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:49.836878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:49.837151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:49.846914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:50:49.851685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:50:49.852816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:50:49.854046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 427/874] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:50:49.858869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:49.889219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:49.955083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f35d5-6c19-498e-bca1-e0495421df92 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:49.987685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:49.988274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:49.988588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:49.988859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:49.989586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:49.989886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:49.991226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:49.999490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 448/875] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:50.005286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:50.047762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:50.101830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842713e6-781f-4496-97e8-6a4a40b97207 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:50.135596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:50.136202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:50.136514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:50.136787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] PATH_INFO: `/v3/users/b77091e6bc544abb8e1297004175a9cc` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:50.137890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] RBAC: Authorizing `identity:get_user(user_id=b77091e6bc544abb8e1297004175a9cc)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:50.139327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:50.140888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 428/876] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:50:50 2022] GET /identity/v3/users/b77091e6bc544abb8e1297004175a9cc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:50.146649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:50.239144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:50.245474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be9bbb-f993-4b17-ad6a-efd67cf43f43 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:50.277802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:50.278395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:50.278675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:50.278969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:50.343126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:50.344585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:50.431546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:50.438505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 449/877] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:50:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 02:50:50.444505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:50.540101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120c500-9efa-466a-a29a-5e19662e7c15 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:50.550868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:50.572766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf429f-f036-4b7e-aa43-8b104b4bc212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:50.573383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf429f-f036-4b7e-aa43-8b104b4bc212 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:50.573664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf429f-f036-4b7e-aa43-8b104b4bc212 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:50.573937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf429f-f036-4b7e-aa43-8b104b4bc212 None admin] PATH_INFO: `/v3/projects/3fa9eaa5c0a2486ca43d3af9ec24c341` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:50.575049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf429f-f036-4b7e-aa43-8b104b4bc212 None admin] RBAC: Authorizing `identity:get_project(project_id=3fa9eaa5c0a2486ca43d3af9ec24c341)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:50.576496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf429f-f036-4b7e-aa43-8b104b4bc212 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:50.578100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 429/878] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:50:50 2022] GET /identity/v3/projects/3fa9eaa5c0a2486ca43d3af9ec24c341 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:50.584083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:50.679158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574693-82e2-4eb7-ad47-63c26c28d8ea None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:50.712025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:50.712648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:50.712927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:50.713197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:50.713911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=3fa9eaa5c0a2486ca43d3af9ec24c341, user.id=b77091e6bc544abb8e1297004175a9cc) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:50:50.714219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:50.715634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf25f4c-d782-48a9-8d30-43bbd3a25259 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:50.721742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 450/879] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:50:50 2022] GET /identity/v3/role_assignments?user.id=b77091e6bc544abb8e1297004175a9cc&scope.project.id=3fa9eaa5c0a2486ca43d3af9ec24c341&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:52.835455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afe99a-8159-44cc-89ae-53452984fe79 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:52.836002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afe99a-8159-44cc-89ae-53452984fe79 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:52.836002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afe99a-8159-44cc-89ae-53452984fe79 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:52.837350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 430/880] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:52.842535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd4d6-c15d-4375-a9a4-3ea010b0d866 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:52.842932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd4d6-c15d-4375-a9a4-3ea010b0d866 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:52.843074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcd4d6-c15d-4375-a9a4-3ea010b0d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:52.860621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-81fcd4d6-c15d-4375-a9a4-3ea010b0d866 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:52.861782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-81fcd4d6-c15d-4375-a9a4-3ea010b0d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:52.912249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:52.925069 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 451/881] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:53.191767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afe99a-8159-44cc-89ae-53452984fe79 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:53.287932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afe99a-8159-44cc-89ae-53452984fe79 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:53.320753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1398e-8029-43cc-8d60-c893c1704c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:53.321338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1398e-8029-43cc-8d60-c893c1704c94 None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:53.321614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1398e-8029-43cc-8d60-c893c1704c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:53.321881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1398e-8029-43cc-8d60-c893c1704c94 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:53.322545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1398e-8029-43cc-8d60-c893c1704c94 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:53.323943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1398e-8029-43cc-8d60-c893c1704c94 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:53.411514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 431/882] 10.222.0.13 () {60 vars in 1138 bytes} [Fri Oct 14 02:50:53 2022] POST /identity/v3/domains => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 02:50:55.529038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd7ad-e0a3-4786-acdc-226c15edde4b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:55.529633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd7ad-e0a3-4786-acdc-226c15edde4b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:55.529633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddd7ad-e0a3-4786-acdc-226c15edde4b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:55.530915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 452/883] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:55.536233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:55.536690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:55.536820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:55.554887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:55.556097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:55.584556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:55.620281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 432/884] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:55.886883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddd7ad-e0a3-4786-acdc-226c15edde4b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:55.983879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddd7ad-e0a3-4786-acdc-226c15edde4b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:56.016049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68719193-d608-4381-a082-fad54dcbd4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:56.016685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68719193-d608-4381-a082-fad54dcbd4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:56.016965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68719193-d608-4381-a082-fad54dcbd4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:56.017237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68719193-d608-4381-a082-fad54dcbd4f6 None admin] PATH_INFO: `/v3/domains/f753f4843ce542c3b9277f74c4651eae` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:56.027054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68719193-d608-4381-a082-fad54dcbd4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f753f4843ce542c3b9277f74c4651eae)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:56.029099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68719193-d608-4381-a082-fad54dcbd4f6 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:56.030629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 453/885] 10.222.0.13 () {56 vars in 1183 bytes} [Fri Oct 14 02:50:55 2022] GET /identity/v3/domains/f753f4843ce542c3b9277f74c4651eae => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:56.036303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:56.129849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d98a8e-bd1a-4a9c-880c-6393ed69fb4f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:56.163160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0152f-5c1d-49fb-a687-32c659fffb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:56.163699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0152f-5c1d-49fb-a687-32c659fffb2c None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:56.163980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0152f-5c1d-49fb-a687-32c659fffb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:56.164255 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0152f-5c1d-49fb-a687-32c659fffb2c None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:56.164926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0152f-5c1d-49fb-a687-32c659fffb2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:56.166358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0152f-5c1d-49fb-a687-32c659fffb2c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:56.279326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 433/886] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:50:56 2022] POST /identity/v3/projects => generated 361 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:50:58.421256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9ba9-ae52-470f-aa7c-b7a4a060075c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:58.421826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9ba9-ae52-470f-aa7c-b7a4a060075c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:58.421826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9ba9-ae52-470f-aa7c-b7a4a060075c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:58.423130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 454/887] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:50:58.428453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:58.428897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:58.429004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:58.446630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:50:58.447796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:50:58.461696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:58.513181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 434/888] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:50:58.778888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e9ba9-ae52-470f-aa7c-b7a4a060075c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:58.828816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:50:58.877682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e9ba9-ae52-470f-aa7c-b7a4a060075c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:58.909585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e97270-6cc9-4b57-af23-a9762d709ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:58.910192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e97270-6cc9-4b57-af23-a9762d709ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:58.910467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e97270-6cc9-4b57-af23-a9762d709ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:58.910736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e97270-6cc9-4b57-af23-a9762d709ed3 None admin] PATH_INFO: `/v3/domains/f753f4843ce542c3b9277f74c4651eae` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:58.911818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e97270-6cc9-4b57-af23-a9762d709ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f753f4843ce542c3b9277f74c4651eae)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:58.913325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e97270-6cc9-4b57-af23-a9762d709ed3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:58.914841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 455/889] 10.222.0.13 () {56 vars in 1183 bytes} [Fri Oct 14 02:50:58 2022] GET /identity/v3/domains/f753f4843ce542c3b9277f74c4651eae => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:50:58.920589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:50:59.015381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1ec52-3796-4fd5-8912-fd8f4f59b5ca None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:50:59.048208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fcf6f8-2385-4a2e-8880-07a5830b88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:50:59.048830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcf6f8-2385-4a2e-8880-07a5830b88ec None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:50:59.049111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcf6f8-2385-4a2e-8880-07a5830b88ec None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:50:59.049381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fcf6f8-2385-4a2e-8880-07a5830b88ec None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:50:59.050012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcf6f8-2385-4a2e-8880-07a5830b88ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:50:59.051436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fcf6f8-2385-4a2e-8880-07a5830b88ec None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:50:59.135334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 435/890] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:50:58 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:51:01.304339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd57b5-94c5-4f49-a285-23e0486e8c48 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:01.306337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd57b5-94c5-4f49-a285-23e0486e8c48 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:01.306622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd57b5-94c5-4f49-a285-23e0486e8c48 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:01.307978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 456/891] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:51:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:51:01.314098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:01.314528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:01.314680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:01.327460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:01.332702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:51:01.333869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:51:01.398182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 436/892] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:51:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:51:01.661814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd57b5-94c5-4f49-a285-23e0486e8c48 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:01.760489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd57b5-94c5-4f49-a285-23e0486e8c48 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:01.780338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:01.797932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:01.798947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:01.798947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:01.799205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:01.809223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:51:01.813960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:51:01.815167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:51:01.816303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 457/893] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:51:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:51:01.821260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:01.915450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b05c8-6385-4c2b-9b50-65a90c3806c0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:01.947765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:01.948353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:01.948663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:01.948936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:01.949588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:51:01.950414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:01.951764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:01.953893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:01.959837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 437/894] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:01.966174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:02.061489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09065b-9579-4382-8994-1deb9a568cd6 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:02.094166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:02.094778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:02.095058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:02.095330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] PATH_INFO: `/v3/users/2cb60fb501bd4fecbd4862c54939e10c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:02.107683 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] RBAC: Authorizing `identity:get_user(user_id=2cb60fb501bd4fecbd4862c54939e10c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:02.109143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:02.110682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 458/895] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:51:01 2022] GET /identity/v3/users/2cb60fb501bd4fecbd4862c54939e10c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:02.116378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:02.212039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1883bf2-e440-4c20-ab50-581d11adaea0 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:02.245298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7348-9095-49e0-9aba-5a9c6d94ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:02.245919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7348-9095-49e0-9aba-5a9c6d94ab3c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:02.246196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7348-9095-49e0-9aba-5a9c6d94ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:02.246488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7348-9095-49e0-9aba-5a9c6d94ab3c None admin] PATH_INFO: `/v3/projects/5032b88994d947ab8a677ae255ac78e0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:02.247582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7348-9095-49e0-9aba-5a9c6d94ab3c None admin] RBAC: Authorizing `identity:get_project(project_id=5032b88994d947ab8a677ae255ac78e0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:02.249030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7348-9095-49e0-9aba-5a9c6d94ab3c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:02.250635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 438/896] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:51:02 2022] GET /identity/v3/projects/5032b88994d947ab8a677ae255ac78e0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:02.256685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:02.290545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:02.353068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e701c9-d730-4aed-840c-9dc80d4ee72b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:02.386254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757b2e3-aec8-47a8-a429-deffb7c2acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:02.386908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b2e3-aec8-47a8-a429-deffb7c2acbc None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:02.387776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b2e3-aec8-47a8-a429-deffb7c2acbc None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:02.388050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757b2e3-aec8-47a8-a429-deffb7c2acbc None admin] PATH_INFO: `/v3/projects/5032b88994d947ab8a677ae255ac78e0/users/2cb60fb501bd4fecbd4862c54939e10c/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:02.390032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b2e3-aec8-47a8-a429-deffb7c2acbc None admin] RBAC: Authorizing `identity:create_grant(project_id=5032b88994d947ab8a677ae255ac78e0, user_id=2cb60fb501bd4fecbd4862c54939e10c, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:02.391456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757b2e3-aec8-47a8-a429-deffb7c2acbc None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:02.465042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 459/897] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:51:02 2022] PUT /identity/v3/projects/5032b88994d947ab8a677ae255ac78e0/users/2cb60fb501bd4fecbd4862c54939e10c/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:51:04.554685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6db92-a6c0-4cb3-bd75-5356411e8530 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:04.555215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6db92-a6c0-4cb3-bd75-5356411e8530 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:04.555215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6db92-a6c0-4cb3-bd75-5356411e8530 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:04.556598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 439/898] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:51:04.562338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:04.562707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:04.562890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:04.581254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:51:04.582427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:51:04.645986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 460/899] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:51:04.912489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6db92-a6c0-4cb3-bd75-5356411e8530 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:04.977814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:05.011222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6db92-a6c0-4cb3-bd75-5356411e8530 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:05.044766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:05.045380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:05.045661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:05.045935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:05.055631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:51:05.060377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:51:05.061465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:51:05.062485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 440/900] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:51:05.067330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:05.091737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:05.163463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af08d8-0f46-4678-8da1-641412d0a1bc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:05.195479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:05.196070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:05.196349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:05.196654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:05.197308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:51:05.197608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:05.198958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:05.207230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 461/901] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:05.212969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:05.309035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58045e98-0a57-422b-9563-2632e4ff8fde None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:05.335522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:05.348955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:05.349568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:05.349847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:05.350115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] PATH_INFO: `/v3/users/2cb60fb501bd4fecbd4862c54939e10c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:05.351207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] RBAC: Authorizing `identity:get_user(user_id=2cb60fb501bd4fecbd4862c54939e10c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:05.352659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:05.354217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 441/902] 10.222.0.13 () {56 vars in 1177 bytes} [Fri Oct 14 02:51:05 2022] GET /identity/v3/users/2cb60fb501bd4fecbd4862c54939e10c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:05.360171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:05.443110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:05.457579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227791d3-c253-4e20-838c-d19622b3aaa3 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:05.493493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:05.494097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:05.494378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:05.494659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:05.561971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:05.563685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:05.648814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:05.664221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 462/903] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:51:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:51:05.670208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:05.772789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65fe8-04f0-478c-9bad-bc7a6eec7d0b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:05.807981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0c313-7f1c-4ebb-96ac-6ba5619377bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:05.808636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0c313-7f1c-4ebb-96ac-6ba5619377bc None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:05.809534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0c313-7f1c-4ebb-96ac-6ba5619377bc None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:05.809810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0c313-7f1c-4ebb-96ac-6ba5619377bc None admin] PATH_INFO: `/v3/projects/5032b88994d947ab8a677ae255ac78e0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:05.810930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0c313-7f1c-4ebb-96ac-6ba5619377bc None admin] RBAC: Authorizing `identity:get_project(project_id=5032b88994d947ab8a677ae255ac78e0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:05.812362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0c313-7f1c-4ebb-96ac-6ba5619377bc None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:05.814028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 442/904] 10.222.0.13 () {56 vars in 1186 bytes} [Fri Oct 14 02:51:05 2022] GET /identity/v3/projects/5032b88994d947ab8a677ae255ac78e0 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:05.822591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:51:05.932612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89194917-eecc-44e0-97ba-cd23e082e944 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:51:05.971758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:51:05.972363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:51:05.972815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:51:05.973090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:51:05.973814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=5032b88994d947ab8a677ae255ac78e0, user.id=2cb60fb501bd4fecbd4862c54939e10c) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:51:05.974124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:51:05.975553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e73e-4422-413c-a46a-99954626f229 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:51:05.981771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 463/905] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:51:05 2022] GET /identity/v3/role_assignments?user.id=2cb60fb501bd4fecbd4862c54939e10c&scope.project.id=5032b88994d947ab8a677ae255ac78e0&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:51:15.803741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=69 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:51:15.978754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=75 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:17.821310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188676d-8472-4b43-b17f-152b11215224 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:17.821894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188676d-8472-4b43-b17f-152b11215224 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:17.821894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188676d-8472-4b43-b17f-152b11215224 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:17.823199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 443/906] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:17.828245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:17.833153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:17.833153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:17.846453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:17.849186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:17.915007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 464/907] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:18.186655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188676d-8472-4b43-b17f-152b11215224 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:18.286049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188676d-8472-4b43-b17f-152b11215224 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:18.319264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:18.319882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:18.320163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:18.320460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:18.330252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:18.331680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:18.346685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:18.350045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:18.351104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:18.351104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:18.351104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:18.351104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 444/908] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:18.354541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:18.449549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50832eb-436c-456e-bfa8-97bc1df18cec None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:18.477913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:18.483626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:18.484227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:18.484607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:18.484884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:18.485523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:18.485826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:18.487239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c1492-be62-4a39-85d7-33db95e8c5b3 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:18.498266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 465/909] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:18.503740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:18.556685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:18.603211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff567cb-8b7c-4041-8a3f-0ba2438a1ded None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:18.636219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1726bdc-6712-4cc3-9b49-266bdbc6015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:18.636852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726bdc-6712-4cc3-9b49-266bdbc6015d None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:18.637133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726bdc-6712-4cc3-9b49-266bdbc6015d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:18.637408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1726bdc-6712-4cc3-9b49-266bdbc6015d None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:18.638046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726bdc-6712-4cc3-9b49-266bdbc6015d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:18.639468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1726bdc-6712-4cc3-9b49-266bdbc6015d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:18.770220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 445/910] 10.222.0.13 () {60 vars in 1132 bytes} [Fri Oct 14 02:52:18 2022] POST /identity/v3/users => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:52:20.939795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f1bdd-e30d-48d0-a5ab-846675c70ef9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:20.940310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f1bdd-e30d-48d0-a5ab-846675c70ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:20.940310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f1bdd-e30d-48d0-a5ab-846675c70ef9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:20.941614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 466/911] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:20.947205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:20.947618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:20.947758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:20.966308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:20.967492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:21.032714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 446/912] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:21.305325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f1bdd-e30d-48d0-a5ab-846675c70ef9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:21.405329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f1bdd-e30d-48d0-a5ab-846675c70ef9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:21.439139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:21.439766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:21.440045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:21.440316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:21.451319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:52:21.456141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:21.457228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:21.458100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 467/913] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:52:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:21.463372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:21.503200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:21.560732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b19593-0914-490d-9920-4f50f4dd54a7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:21.593521 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:21.594118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:21.594400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:21.594674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:21.595333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] RBAC: Adding query filter params (name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:21.595638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:21.597044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:21.605349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 447/914] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:52:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:21.611123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:21.660601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:21.708664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c77a1-59f4-475e-83a2-fb493101a435 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:21.741764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061611-b373-414d-aab1-2825214b298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:21.742383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061611-b373-414d-aab1-2825214b298a None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:21.742663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061611-b373-414d-aab1-2825214b298a None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:21.742961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061611-b373-414d-aab1-2825214b298a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:21.753102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061611-b373-414d-aab1-2825214b298a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:21.754514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061611-b373-414d-aab1-2825214b298a None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-3e061611-b373-414d-aab1-2825214b298a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:21.768757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:21.772572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:21.773660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:21.773660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:21.773660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:21.773660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 468/915] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:21.775644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:21.872071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:21.874888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbabc0b-54ea-411e-8293-df6706d49378 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:21.907846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:21.908471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:21.908751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:21.909021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:21.909648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:21.909951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:21.911296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:21.922534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 448/916] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:21.928317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061611-b373-414d-aab1-2825214b298a None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.026688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061611-b373-414d-aab1-2825214b298a None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:22.028159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:22.059615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:22.060231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:22.060539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:22.060812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:22.068034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:22.069562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:52:22.080529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:22.081703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:22.082673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 469/917] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:22.087993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.184701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf812-6eed-4976-ad3f-9d683beecd1f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:22.219222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:22.219896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:22.220236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:22.220490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:22.221211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:22.221515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:22.222976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:22.239778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 449/918] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Oct 14 02:52:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:22.245611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.345051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92e1c2-9f0c-48e9-ab69-476e96ec3e7b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:22.377349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:22.377957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:22.378232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:22.378499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:22.389304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:22.390719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:22.404968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:22.406079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:22.407356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:22.407356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:22.407356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:22.407356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 470/919] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:52:22.411771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.430707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:22.508805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc3eb2-d8c1-4e75-98fd-dc15d609883f None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:22.542466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:22.543063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:22.543340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:22.543608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:22.544238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:22.544572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:22.545923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:22.557063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 450/920] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:22.562764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.579200 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:22.660981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7515b-13f2-4e33-9976-06816b8b2941 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:22.694932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:22.695551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:22.695935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:22.696207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:22.702759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:22.704186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:52:22.715099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:22.716255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:22.717426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 471/921] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:52:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:22.722101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.797791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:22.818298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a63490-3e1c-457f-a9ee-b57b383ef611 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:22.849956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:22.850579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:22.850858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:22.851128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:22.851808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:22.852114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:22.853570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c253fd5-0a2e-4c1c-a458-4e0a0e90c446 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:22.865405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 451/922] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:22.871862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:22.945668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:22.969147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5bf67-b2a9-47c3-990a-95b3cd2df1da None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:23.002317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587858a-5455-4985-9f17-ec27a24bf6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:23.002925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587858a-5455-4985-9f17-ec27a24bf6da None admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:23.003205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587858a-5455-4985-9f17-ec27a24bf6da None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:23.003480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587858a-5455-4985-9f17-ec27a24bf6da None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/75afccceda7e4c1692631acb70edce96/roles/f14afada80ad4b70a13d8944317f7dbc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:23.017607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587858a-5455-4985-9f17-ec27a24bf6da None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=75afccceda7e4c1692631acb70edce96, role_id=f14afada80ad4b70a13d8944317f7dbc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:23.019025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587858a-5455-4985-9f17-ec27a24bf6da None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:23.107693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 472/923] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:52:22 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/75afccceda7e4c1692631acb70edce96/roles/f14afada80ad4b70a13d8944317f7dbc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:52:25.207184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a15e-0e3d-4d91-9839-74f3745be71b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:25.207748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a15e-0e3d-4d91-9839-74f3745be71b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:25.207748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a15e-0e3d-4d91-9839-74f3745be71b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:25.209126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 452/924] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:25.215057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d057-efc3-4421-a499-856745721d4d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:25.215477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d057-efc3-4421-a499-856745721d4d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:25.215706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d057-efc3-4421-a499-856745721d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:25.233410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b095d057-efc3-4421-a499-856745721d4d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:25.234621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b095d057-efc3-4421-a499-856745721d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:25.299548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 473/925] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:25.569197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a15e-0e3d-4d91-9839-74f3745be71b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:25.668231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a15e-0e3d-4d91-9839-74f3745be71b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:25.704215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:25.704851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:25.705128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:25.705398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:25.712070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:25.715783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:52:25.720435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:25.721547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:25.722474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 453/926] 10.222.0.13 () {56 vars in 1102 bytes} [Fri Oct 14 02:52:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:25.727520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d057-efc3-4421-a499-856745721d4d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:25.780629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:25.822386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d057-efc3-4421-a499-856745721d4d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:25.855122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:25.855719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:25.855999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:25.856273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:25.856958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:25.857256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:25.858612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:25.866749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 474/927] 10.222.0.13 () {56 vars in 1103 bytes} [Fri Oct 14 02:52:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:25.872721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:25.970372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fc57f-961d-4a83-ae9e-c47705b082f6 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:26.003647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:26.004260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:26.004602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:26.004873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:26.014774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:26.016196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:26.030293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:26.031391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:26.032535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:26.032535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:26.032535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:26.032535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 454/928] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:26.037762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:26.135728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d682d2-4695-4e3c-8bc3-2dc9e1fdce00 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:26.152043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:26.169632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:26.170232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:26.170511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:26.170788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:26.171549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:26.171854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:26.173233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:26.184497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 475/929] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:52:26.190201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:26.243984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:26.293493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee994a-6c05-4c61-96de-b474a838fa6c None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:26.326683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:26.327303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:26.327575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:26.327847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:26.335001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:26.336440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:52:26.347093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:26.351789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:26.352979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 455/930] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:26.354224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:26.451957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb59fc5-03fa-487e-9303-c2fc2c0356c1 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:26.485107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:26.485692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:26.485975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:26.486246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:26.486963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:26.487265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:26.488705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:26.505980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 476/931] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Oct 14 02:52:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:52:26.512434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:26.615896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de17389-56d5-4b18-9204-063b3d6f2e9d None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:26.626792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:26.649496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:26.653155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:26.653155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:26.653155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:26.715659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:26.717076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:26.811328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 456/932] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:52:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 14 02:52:26.817335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:26.850987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:26.913526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d6789-b357-4c6e-b719-49d250cf6247 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:26.947811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:26.948468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:26.948795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:26.949072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:26.958716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:26.960812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:26.975140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:26.976324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:26.977605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:26.977605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:26.977605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:26.977605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 477/933] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:26.981838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:26.993152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:27.079265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3fcc5-4a49-47bb-bf34-05b49557c4fe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:27.112257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:27.112888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:27.113170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:27.113445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:27.114083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:27.114389 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:27.116273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:27.127253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 457/934] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:27.133818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:27.217387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:27.231711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c2341-6296-460f-b04d-294d5db7d73b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:27.265628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:27.266240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:27.266517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:27.266784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:27.273292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:27.274686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:52:27.286225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:27.287217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:27.288430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 478/935] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:27.293292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:27.359458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:27.390460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041ab43-7451-440d-97d0-ac328d1dc90a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:27.422245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:27.422849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:27.423130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:27.423403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:27.424090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:27.424418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:27.425851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf180b-42c8-4b9e-8127-bde39b86f86f None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:27.438531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 458/936] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:27.445137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:27.541990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c1bb4-45bc-440b-a206-3e6e9e5f7566 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:27.574732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:27.575321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:27.575595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:27.575860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:27.576606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] RBAC: Adding query filter params (role.id=f14afada80ad4b70a13d8944317f7dbc, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=75afccceda7e4c1692631acb70edce96) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:27.576911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:27.578323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6c0be-4d94-4f6f-a6ba-15bb69ea10c2 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:27.583831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 479/937] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:52:27 2022] GET /identity/v3/role_assignments?user.id=75afccceda7e4c1692631acb70edce96&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=f14afada80ad4b70a13d8944317f7dbc => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:29.746655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3fcf-03af-4538-97e6-47c59c1702bb None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:29.747197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3fcf-03af-4538-97e6-47c59c1702bb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:29.747197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3fcf-03af-4538-97e6-47c59c1702bb None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:29.748580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 459/938] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:29.753604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:29.754041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:29.754144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:29.773401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:29.774574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:29.777323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:29.837844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 480/939] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:30.101316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3fcf-03af-4538-97e6-47c59c1702bb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:30.201442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3fcf-03af-4538-97e6-47c59c1702bb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:30.229185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:30.234823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:30.235449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:30.235729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:30.236001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:30.247127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:52:30.251970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:30.253119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:30.254304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 460/940] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:30.260251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:30.357253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451684a-9b3f-4094-8706-c8630b90c79f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:30.391264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:30.391862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:30.392146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:30.392442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:30.393107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:30.393412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:30.394848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:30.402723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 481/941] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:52:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:30.408633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:30.510010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70376c3-f084-4ec6-81f2-9102e187f4f2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:30.542718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:30.543329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:30.543601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:30.543882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:30.553926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:30.555358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:30.569257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:30.570358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:30.571528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:30.571528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:30.571528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:30.571528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 461/942] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:30.576320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:30.579174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:30.675123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1945c-615e-4d00-94e6-0a431c786848 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:30.708169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:30.708848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:30.709126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:30.709394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:30.710026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:30.710327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:30.711709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:30.723185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 482/943] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:30.729599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:30.772803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:30.827797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88436cdb-f4e7-48f3-a9af-3b87d1785356 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:30.861819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:30.862437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:30.862717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:30.862983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:30.870311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:30.871729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:52:30.882719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:30.883981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:30.885013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 462/944] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:30.891688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:30.952829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:30.989875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454c186-c04a-4b39-8393-c7b8aa030852 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:31.023015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:31.023601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:31.023895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:31.024163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:31.024900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:31.025199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:31.026598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:31.043989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 483/945] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Oct 14 02:52:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:31.049933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:31.146600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3280c7-d839-4c4c-af5c-d8c28edcc50b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:31.148649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:31.180021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:31.180686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:31.180969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:31.181247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:31.191099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:31.192562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:31.207110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:31.208181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:31.209308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:31.209308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:31.209308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:31.209308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 463/946] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 14 02:52:31.214687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:31.311267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f17414-831f-4f2d-83f7-88bacb82071d None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:31.331594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:31.345614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:31.346211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:31.346492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:31.346764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:31.347396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:31.347699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:31.349086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:31.359968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 484/947] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:31.365787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:31.465993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610e695-c45d-47d9-896c-c96c6eb473d2 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:31.498653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003028b-cff7-4a59-af35-11af628385df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:31.499269 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003028b-cff7-4a59-af35-11af628385df None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:31.499552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003028b-cff7-4a59-af35-11af628385df None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:31.499828 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003028b-cff7-4a59-af35-11af628385df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:31.506625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003028b-cff7-4a59-af35-11af628385df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:31.511954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003028b-cff7-4a59-af35-11af628385df None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-3003028b-cff7-4a59-af35-11af628385df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:52:31.519594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:31.520619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:31.521701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 464/948] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:31.527152 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:31.624341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff3b89-c0c9-473c-a01c-17165b0c73ac None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:31.658420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:31.659023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:31.662001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:31.662001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:31.662001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:31.662001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:31.662001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73ae51-9897-4fc1-bb72-c6152ea5e09f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:31.673530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 485/949] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:31.679904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003028b-cff7-4a59-af35-11af628385df None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:31.696303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:31.777743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003028b-cff7-4a59-af35-11af628385df None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:31.811287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb469d7d-2448-4206-bd23-8ad41427b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:31.811933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb469d7d-2448-4206-bd23-8ad41427b2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:31.812213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb469d7d-2448-4206-bd23-8ad41427b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:31.812512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb469d7d-2448-4206-bd23-8ad41427b2d0 None admin] PATH_INFO: `/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/75afccceda7e4c1692631acb70edce96/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:31.814421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb469d7d-2448-4206-bd23-8ad41427b2d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=186ad6a443ae4fd4ae201dc2e7541a98, user_id=75afccceda7e4c1692631acb70edce96, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:31.815843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb469d7d-2448-4206-bd23-8ad41427b2d0 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:31.877175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 465/950] 10.222.0.13 () {58 vars in 1439 bytes} [Fri Oct 14 02:52:31 2022] PUT /identity/v3/projects/186ad6a443ae4fd4ae201dc2e7541a98/users/75afccceda7e4c1692631acb70edce96/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 02:52:33.996649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3d22-d690-49a0-9447-458716a869b0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:33.997161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3d22-d690-49a0-9447-458716a869b0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:33.997161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e3d22-d690-49a0-9447-458716a869b0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:33.998497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 486/951] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:34.003507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c12454-144d-470b-81d7-721a724e8728 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:34.003939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c12454-144d-470b-81d7-721a724e8728 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:34.004074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c12454-144d-470b-81d7-721a724e8728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:34.022768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-66c12454-144d-470b-81d7-721a724e8728 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:34.023973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-66c12454-144d-470b-81d7-721a724e8728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:34.089708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 466/952] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:34.359086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e3d22-d690-49a0-9447-458716a869b0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:34.401295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:34.457471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e3d22-d690-49a0-9447-458716a869b0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:34.489449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:34.490062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:34.490345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:34.490617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:34.501856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 14 02:52:34.506877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:34.508017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:34.509063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 487/953] 10.222.0.13 () {56 vars in 1096 bytes} [Fri Oct 14 02:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:34.514096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c12454-144d-470b-81d7-721a724e8728 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:34.517182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:34.611590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c12454-144d-470b-81d7-721a724e8728 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:34.644586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:34.645177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:34.645452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:34.645720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:34.646371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:34.646669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:34.648606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:34.658130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 467/954] 10.222.0.13 () {56 vars in 1099 bytes} [Fri Oct 14 02:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:34.664560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:34.760298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:34.763194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb986620-c4a5-48b3-b35d-223a473ce366 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:34.796444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:34.797083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:34.797372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:34.797643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:34.808376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:34.809854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:34.823662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:34.824694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:34.825841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:34.825841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:34.825841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:34.825841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 488/955] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:34.830851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:34.895082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:34.928892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54812dad-73fa-4b8f-8a6d-79a2ca13e42a None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:34.962260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:34.962863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:34.963145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:34.963419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:34.964059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:34.964363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:34.965752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:34.977351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 468/956] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:34.982998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:35.079810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287931f3-06aa-431c-8f7d-fe78c751be8b None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:35.112437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:35.113055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:35.113334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:35.113606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:35.120751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:35.139301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:35.140285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:35.141295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 489/957] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:35.142055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:35.237530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2844200-a32e-4d34-8318-905b2ec1ac04 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:35.262864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:35.271118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:35.271718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:35.271997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:35.272273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:35.273629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:35.273935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:35.275415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:35.292310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 469/958] 10.222.0.13 () {56 vars in 1143 bytes} [Fri Oct 14 02:52:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:35.298186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:35.314801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:35.397932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d09cb-a20c-4e8d-a9d6-ebe977d8d5a4 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:35.431419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:35.432019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:35.432297 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:35.432599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:35.498342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:35.499720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:35.512822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:35.595461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 490/959] 10.222.0.13 () {58 vars in 1282 bytes} [Fri Oct 14 02:52:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 14 02:52:35.601859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:35.701024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2417c15-1e32-41b9-9803-ab1cfe9ff455 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:35.734476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:35.735108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:35.735392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:35.735668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:35.745638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:35.747070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 14 02:52:35.762187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:35.763282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 14 02:52:35.764407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 14 02:52:35.764407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 14 02:52:35.764407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:35.764407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 470/960] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 02:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:35.769145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:35.865501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd642c06-58ea-4bfb-a68b-4ece99e19fdd None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:35.878390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:35.899825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:35.908946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:35.908946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:35.908946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:35.908946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:35.908946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:35.908946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:35.914131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 491/961] 10.222.0.13 () {56 vars in 1109 bytes} [Fri Oct 14 02:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:35.919782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:35.956995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:36.019467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251a815-1b9b-44dd-8883-4591f0699fbe None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:36.052998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:36.055398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:36.055398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:36.055398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:36.061522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:36.062955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 14 02:52:36.074436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:36.075481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: ERROR keystone.server.flask.application Oct 14 02:52:36.076443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 471/962] 10.222.0.13 () {56 vars in 1111 bytes} [Fri Oct 14 02:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:36.081476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:36.178529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e867e-baab-4078-8117-84f5b3e5e314 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:36.211323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:36.211918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:36.212199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:36.212499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:36.213186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:36.213493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:36.214909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675208b-820c-46d8-9bc5-043deb998a66 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:36.226912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 492/963] 10.222.0.13 () {56 vars in 1148 bytes} [Fri Oct 14 02:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 02:52:36.232978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:36.330766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:36.336727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec12e-153e-4c7a-9bcf-b5986593986b None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:36.369938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:36.370531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:36.370810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:36.371079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:36.371793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] RBAC: Adding query filter params (role.id=a81833492ef64a3aae0d349c9c3c3116, scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98, user.id=75afccceda7e4c1692631acb70edce96) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:36.372098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:36.373615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd56883-22b1-470e-b57f-dd2bc3404160 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:36.379097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 472/964] 10.222.0.13 () {56 vars in 1374 bytes} [Fri Oct 14 02:52:36 2022] GET /identity/v3/role_assignments?user.id=75afccceda7e4c1692631acb70edce96&scope.project.id=186ad6a443ae4fd4ae201dc2e7541a98&role.id=a81833492ef64a3aae0d349c9c3c3116 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:38.512649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e44500-485b-46fb-8dc8-d69840bbe622 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:38.513183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e44500-485b-46fb-8dc8-d69840bbe622 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:38.513183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e44500-485b-46fb-8dc8-d69840bbe622 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:38.514506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 493/965] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:38.519832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:38.520286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:38.520382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:38.539289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:38.540503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:38.604482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 473/966] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:38.867780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e44500-485b-46fb-8dc8-d69840bbe622 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:38.899339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:38.967845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e44500-485b-46fb-8dc8-d69840bbe622 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:39.000877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:39.001497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:39.001775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:39.002046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:39.002639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:39.004166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:39.013444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:39.014753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:39.015775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 494/967] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:52:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:39.020594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:39.110059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:39.120233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639705f-6f47-4404-913f-fb10d533afbc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:39.154257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:39.154858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:39.155138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:39.155411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:39.158308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] RBAC: Adding query filter params (name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:39.158308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:39.158308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344953c0-0553-4479-bf26-788d8fda0fee None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:39.162437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 474/968] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Oct 14 02:52:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:39.168576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:39.264532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:39.270147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62325a-707e-4f9a-bb8c-4a89767c8286 None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:39.301791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:39.302390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:39.302667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:39.302935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] PATH_INFO: `/v3/services` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:39.303560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:39.304402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:39.305748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aca86b-3640-4212-a6b6-fce75400f021 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:39.309993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 495/969] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Oct 14 02:52:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:41.406541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8877d-c112-4644-a0db-ef0f88a1a237 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:41.407073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8877d-c112-4644-a0db-ef0f88a1a237 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:41.407161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8877d-c112-4644-a0db-ef0f88a1a237 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:41.408472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 475/970] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:41.414485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8dc8e-6b4f-488b-b3d1-b9bbc42d8ee5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:41.414926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8dc8e-6b4f-488b-b3d1-b9bbc42d8ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:41.414926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8dc8e-6b4f-488b-b3d1-b9bbc42d8ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:41.432803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-dad8dc8e-6b4f-488b-b3d1-b9bbc42d8ee5 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:41.435719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dad8dc8e-6b4f-488b-b3d1-b9bbc42d8ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:41.498905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 496/971] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:41.766421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8877d-c112-4644-a0db-ef0f88a1a237 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:41.865970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8877d-c112-4644-a0db-ef0f88a1a237 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:41.899789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1b84-c5c6-40bd-813e-2c8753fddf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:41.900410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1b84-c5c6-40bd-813e-2c8753fddf3c None admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:41.900703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1b84-c5c6-40bd-813e-2c8753fddf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:41.900975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1b84-c5c6-40bd-813e-2c8753fddf3c None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:41.901620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1b84-c5c6-40bd-813e-2c8753fddf3c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:41.902975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1b84-c5c6-40bd-813e-2c8753fddf3c None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:41.980778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 476/972] 10.222.0.13 () {60 vars in 1141 bytes} [Fri Oct 14 02:52:41 2022] POST /identity/v3/services => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:52:44.133850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3adcd-9a5c-4d0c-88d1-0d46d61bd697 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:44.134388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3adcd-9a5c-4d0c-88d1-0d46d61bd697 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:44.134484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3adcd-9a5c-4d0c-88d1-0d46d61bd697 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:44.135754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 497/973] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:44.140928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:44.141350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:44.141482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:44.160035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:44.161257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:44.170265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:44.232030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 477/974] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:44.505642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3adcd-9a5c-4d0c-88d1-0d46d61bd697 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:44.593744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:44.603727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3adcd-9a5c-4d0c-88d1-0d46d61bd697 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:44.637668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:44.638295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:44.638569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:44.638845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:44.639417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:44.640806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:44.649320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:44.650504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:44.651559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 498/975] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:52:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:44.656618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:44.754339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c170-956b-4ea5-be10-837976b9bf60 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:44.789745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:44.790284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:44.790563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:44.790834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:44.791459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:44.791762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:44.793182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:44.798091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 478/976] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Oct 14 02:52:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:44.804719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:44.899477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70a5c3-b357-4621-9965-64ca6c71487f None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:44.932016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:44.932634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:44.932912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:44.933178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:44.933871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] RBAC: Adding query filter params (interface=public, service_id=4eed4e1fd2c44b4987df0aa4e42fdd95, region_id=RegionOne) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:44.934177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:44.935574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf461276-dcb4-4cb7-ae01-d7f5112b92a7 None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:44.940307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 499/977] 10.222.0.13 () {56 vars in 1251 bytes} [Fri Oct 14 02:52:44 2022] GET /identity/v3/endpoints?service_id=4eed4e1fd2c44b4987df0aa4e42fdd95&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:44.945918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:44.949794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:45.044749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f90d81-3294-43a2-a60c-bee763eee856 None admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:45.077920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c9d06-4c9e-48c7-a229-c89def94d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:45.078514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c9d06-4c9e-48c7-a229-c89def94d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:45.078795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c9d06-4c9e-48c7-a229-c89def94d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:45.079068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c9d06-4c9e-48c7-a229-c89def94d8eb None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:45.079668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c9d06-4c9e-48c7-a229-c89def94d8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:45.081054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c9d06-4c9e-48c7-a229-c89def94d8eb None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:45.088261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 479/978] 10.222.0.13 () {56 vars in 1087 bytes} [Fri Oct 14 02:52:44 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 02:52:47.228063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0db6-0d79-4060-a871-a502426be08b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:47.228642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0db6-0d79-4060-a871-a502426be08b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:47.228642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c0db6-0d79-4060-a871-a502426be08b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:47.229979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 500/979] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:52:47.235122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:47.235542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:47.235679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:47.253530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:52:47.254971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:52:47.315719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:47.321579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 480/980] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:52:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 14 02:52:47.591295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0db6-0d79-4060-a871-a502426be08b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:47.610916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:47.693176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c0db6-0d79-4060-a871-a502426be08b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:47.726613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:47.727275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:47.727556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:47.727829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:47.728423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:47.729785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 14 02:52:47.738369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 14 02:52:47.739606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.get_or_create( Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application with Lock( Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self._enter() Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application return self.creator() Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application created_value = creator( Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: ERROR keystone.server.flask.application Oct 14 02:52:47.740737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 501/981] 10.222.0.13 () {56 vars in 1117 bytes} [Fri Oct 14 02:52:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 14 02:52:47.746307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:47.842014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13726cf8-772a-4ef4-a58e-0e1cbfdd89cc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:47.874260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:47.874857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:47.875136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:47.875411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] PATH_INFO: `/v3/services` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:47.876032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 02:52:47.876335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:47.877725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a31ea-a72b-4d44-a650-a10259974f1e None admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:47.883586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 481/982] 10.222.0.13 () {56 vars in 1116 bytes} [Fri Oct 14 02:52:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 02:52:47.889408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:52:47.968874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:47.985845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b816fef-5e11-4d94-9be8-c85ac0bef8fe None admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:52:48.018235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378ffc7-7f39-4dc7-8d36-792e63f4089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:52:48.018820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ffc7-7f39-4dc7-8d36-792e63f4089d None admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:52:48.019099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ffc7-7f39-4dc7-8d36-792e63f4089d None admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:52:48.019367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ffc7-7f39-4dc7-8d36-792e63f4089d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:52:48.020038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378ffc7-7f39-4dc7-8d36-792e63f4089d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:52:48.021511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378ffc7-7f39-4dc7-8d36-792e63f4089d None admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:52:48.105628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 502/983] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 02:52:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 02:52:57.880068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=69 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:52:58.100417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:50.875676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2cdc-028f-4b88-bdf9-1cf04ade8d63 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:50.876691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2cdc-028f-4b88-bdf9-1cf04ade8d63 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:50.877110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2cdc-028f-4b88-bdf9-1cf04ade8d63 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:50.885384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb617c-8a0c-4f8e-8283-6cca9532719b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:50.885838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb617c-8a0c-4f8e-8283-6cca9532719b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:50.885838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb617c-8a0c-4f8e-8283-6cca9532719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:50.888710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 482/984] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:58:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:58:50.976708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7dbb617c-8a0c-4f8e-8283-6cca9532719b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:58:50.977946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7dbb617c-8a0c-4f8e-8283-6cca9532719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:51.094212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 503/985] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 02:58:51.391710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1325-5f5d-4cd6-a1ba-d6c91e5ef96e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:51.392035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1325-5f5d-4cd6-a1ba-d6c91e5ef96e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:51.392274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1325-5f5d-4cd6-a1ba-d6c91e5ef96e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:51.393896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 483/986] 10.222.0.13 () {54 vars in 964 bytes} [Fri Oct 14 02:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:58:51.400322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f589736-146c-4af8-9fc7-52b10f406dcf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:51.401103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f589736-146c-4af8-9fc7-52b10f406dcf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:51.401627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f589736-146c-4af8-9fc7-52b10f406dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:51.497596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0f589736-146c-4af8-9fc7-52b10f406dcf None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:58:51.498730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0f589736-146c-4af8-9fc7-52b10f406dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:51.522188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:51.588369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 504/987] 10.222.0.13 () {58 vars in 1061 bytes} [Fri Oct 14 02:58:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:58:51.597770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1325-5f5d-4cd6-a1ba-d6c91e5ef96e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:58:51.599803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-440a1325-5f5d-4cd6-a1ba-d6c91e5ef96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:51.867224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1325-5f5d-4cd6-a1ba-d6c91e5ef96e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:58:51.867224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:58:51.867224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:51.867224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:51.868102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:51.868102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:51.876687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:51.934434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:58:51.935899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab37a-94ca-4296-a269-c45233bd556f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:58:51.955866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 484/988] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:58:54.372013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966676-5c6d-4063-a70b-09737b48aa07 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:54.372647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966676-5c6d-4063-a70b-09737b48aa07 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:54.372647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08966676-5c6d-4063-a70b-09737b48aa07 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:54.374051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 505/989] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:58:54.379179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03e042-4612-4a62-a4ac-ea4d075bf060 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:54.379593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03e042-4612-4a62-a4ac-ea4d075bf060 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:54.379701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03e042-4612-4a62-a4ac-ea4d075bf060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:54.450203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6c03e042-4612-4a62-a4ac-ea4d075bf060 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:58:54.451386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6c03e042-4612-4a62-a4ac-ea4d075bf060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:54.544084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 485/990] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:58:54.822858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966676-5c6d-4063-a70b-09737b48aa07 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:58:54.824415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-08966676-5c6d-4063-a70b-09737b48aa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:54.925758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08966676-5c6d-4063-a70b-09737b48aa07 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:58:54.995768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:54.998171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:58:54.998773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:54.999054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:54.999334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:55.000966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:55.113226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:58:55.114684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311a3b3-2c29-432d-b82d-ec0747a50fd6 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:58:55.138270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 506/991] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:58:57.791541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05714d7-2206-4811-a24b-042e42e26b7e None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:57.792064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05714d7-2206-4811-a24b-042e42e26b7e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:57.792064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05714d7-2206-4811-a24b-042e42e26b7e None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:57.793365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 486/992] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:58:57.798563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2eac-c0cd-49cf-800e-58a10e353ec9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:57.799002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2eac-c0cd-49cf-800e-58a10e353ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:57.799097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2eac-c0cd-49cf-800e-58a10e353ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:57.863472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-826c2eac-c0cd-49cf-800e-58a10e353ec9 None None] MFA Rules not processed for user `1d3b79a78dd94570afe565420033ed70`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:58:57.864694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-826c2eac-c0cd-49cf-800e-58a10e353ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:57.914998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:57.960656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 507/993] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:58:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:58:58.243474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05714d7-2206-4811-a24b-042e42e26b7e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:58:58.245036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d05714d7-2206-4811-a24b-042e42e26b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:58.254696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:58.346288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05714d7-2206-4811-a24b-042e42e26b7e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:58:58.418167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:58:58.418696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:58:58.418971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:58:58.419239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:58:58.420882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:58:58.480913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:58:58.526571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:58:58.528001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0750d-5eaf-41fb-be8c-9ff590e567cd service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:58:58.546815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 487/994] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:58:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:01.361516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8349a-70be-49db-90ea-735d2517f80c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:01.368329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8349a-70be-49db-90ea-735d2517f80c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:01.368329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8349a-70be-49db-90ea-735d2517f80c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:01.368329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 508/995] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:01.369064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749788c9-08c9-461c-a6f5-e9cef9fdee20 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:01.369454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749788c9-08c9-461c-a6f5-e9cef9fdee20 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:01.369611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749788c9-08c9-461c-a6f5-e9cef9fdee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:01.433829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-749788c9-08c9-461c-a6f5-e9cef9fdee20 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:01.435005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-749788c9-08c9-461c-a6f5-e9cef9fdee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:01.527355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 488/996] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:01.804675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8349a-70be-49db-90ea-735d2517f80c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:01.806235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-56f8349a-70be-49db-90ea-735d2517f80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:01.906801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8349a-70be-49db-90ea-735d2517f80c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:01.976897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:01.977461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:01.977739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:01.978012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:01.979576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:01.987239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:02.085092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:02.087072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c4d32-8cf1-4b49-8759-a4056638fea9 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:02.104900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 509/997] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:05.190691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f812fb-2a63-46fc-a212-9b0ff5bdae00 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:05.191227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f812fb-2a63-46fc-a212-9b0ff5bdae00 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:05.191227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f812fb-2a63-46fc-a212-9b0ff5bdae00 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:05.192620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 489/998] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:05.198636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9995fa-6170-47ce-91c9-3e0a1de06135 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:05.199036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9995fa-6170-47ce-91c9-3e0a1de06135 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:05.199187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9995fa-6170-47ce-91c9-3e0a1de06135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:05.264944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fb9995fa-6170-47ce-91c9-3e0a1de06135 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:05.266149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fb9995fa-6170-47ce-91c9-3e0a1de06135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:05.323868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:05.363028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 510/999] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:05.646366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f812fb-2a63-46fc-a212-9b0ff5bdae00 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:05.647905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-75f812fb-2a63-46fc-a212-9b0ff5bdae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:05.668337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:05.751969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f812fb-2a63-46fc-a212-9b0ff5bdae00 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:05.825325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:05.825935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:05.826211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:05.826477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:05.828061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:05.898830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:05.938554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:05.940048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cb8de-38ba-4046-9296-7eef965c9209 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:05.961883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 490/1000] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:08.181168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520de88-5e84-43ad-8485-847666425a06 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:08.181715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520de88-5e84-43ad-8485-847666425a06 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:08.181715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520de88-5e84-43ad-8485-847666425a06 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:08.183201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 511/1001] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:08.188426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498153-742d-43d7-9b77-93c62d4d1f72 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:08.188814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498153-742d-43d7-9b77-93c62d4d1f72 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:08.188968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61498153-742d-43d7-9b77-93c62d4d1f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:08.267284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-61498153-742d-43d7-9b77-93c62d4d1f72 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:08.268643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-61498153-742d-43d7-9b77-93c62d4d1f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:08.368787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 491/1002] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:08.649874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520de88-5e84-43ad-8485-847666425a06 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:08.651413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f520de88-5e84-43ad-8485-847666425a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:08.757852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520de88-5e84-43ad-8485-847666425a06 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:08.830348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:08.830951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:08.831252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:08.831521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:08.833137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:08.849860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:08.941748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:08.943193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42bf1d-e9bd-4dc2-b139-f0057ee791ec service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:08.961426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 512/1003] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:11.166294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217a1c7-b98c-457c-b609-ae9083328a36 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:11.166832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217a1c7-b98c-457c-b609-ae9083328a36 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:11.166832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217a1c7-b98c-457c-b609-ae9083328a36 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:11.168215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 492/1004] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:11.173331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065da5f7-0de8-4509-a487-883c6bc0e093 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:11.173708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065da5f7-0de8-4509-a487-883c6bc0e093 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:11.173886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065da5f7-0de8-4509-a487-883c6bc0e093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:11.241815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-065da5f7-0de8-4509-a487-883c6bc0e093 None None] MFA Rules not processed for user `1d3b79a78dd94570afe565420033ed70`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:11.242954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-065da5f7-0de8-4509-a487-883c6bc0e093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:11.307582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:11.339845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 513/1005] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:11.636522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bd31d-7c6f-4892-8aad-060ee429888c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:11.636880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bd31d-7c6f-4892-8aad-060ee429888c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:11.637220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bd31d-7c6f-4892-8aad-060ee429888c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:11.638628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 493/1006] 10.222.0.13 () {54 vars in 964 bytes} [Fri Oct 14 02:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:11.645030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b430-6904-4a22-87c4-5658d3f6c278 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:11.645317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b430-6904-4a22-87c4-5658d3f6c278 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:11.645591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b430-6904-4a22-87c4-5658d3f6c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:11.726985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8350b430-6904-4a22-87c4-5658d3f6c278 None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:11.728281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8350b430-6904-4a22-87c4-5658d3f6c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:11.811510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 514/1007] 10.222.0.13 () {58 vars in 1061 bytes} [Fri Oct 14 02:59:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:11.820568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bd31d-7c6f-4892-8aad-060ee429888c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:11.822092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-165bd31d-7c6f-4892-8aad-060ee429888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:11.852837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:11.924426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bd31d-7c6f-4892-8aad-060ee429888c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:11.997776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:11.998382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:11.998663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:11.998938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:12.000568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:12.076727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:12.110544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:12.111991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51f591-b3fc-415a-ba69-7ffddca1e026 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:12.130165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 494/1008] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:15.046108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa35ac-2b41-4aec-ac1c-58d6de69da56 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:15.046613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa35ac-2b41-4aec-ac1c-58d6de69da56 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:15.046613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa35ac-2b41-4aec-ac1c-58d6de69da56 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:15.047908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 515/1009] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:15.053197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2500353-d698-4bbf-b46a-7f1a447c18ff None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:15.053622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2500353-d698-4bbf-b46a-7f1a447c18ff None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:15.053744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2500353-d698-4bbf-b46a-7f1a447c18ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:15.119457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e2500353-d698-4bbf-b46a-7f1a447c18ff None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:15.120688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e2500353-d698-4bbf-b46a-7f1a447c18ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:15.215924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 495/1010] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:15.498824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa35ac-2b41-4aec-ac1c-58d6de69da56 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:15.500352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-05aa35ac-2b41-4aec-ac1c-58d6de69da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:15.568771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:15.603582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa35ac-2b41-4aec-ac1c-58d6de69da56 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:15.676794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:15.677404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:15.677690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:15.677963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:15.680172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:15.786355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:15.787696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4360357-42c3-44f4-be0a-84b9f844d95c service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:15.797947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:15.807116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 516/1011] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:17.964550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aed89-f1ed-4561-ac24-f1d19d4fea65 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:17.965076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aed89-f1ed-4561-ac24-f1d19d4fea65 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:17.965076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aed89-f1ed-4561-ac24-f1d19d4fea65 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:17.966346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 496/1012] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:17.971445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447ce18-9410-4d47-93da-eed1af15091c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:17.971844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447ce18-9410-4d47-93da-eed1af15091c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:17.971993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447ce18-9410-4d47-93da-eed1af15091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:18.036229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6447ce18-9410-4d47-93da-eed1af15091c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:18.037438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6447ce18-9410-4d47-93da-eed1af15091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:18.133938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 517/1013] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:18.417863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aed89-f1ed-4561-ac24-f1d19d4fea65 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:18.419421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ea9aed89-f1ed-4561-ac24-f1d19d4fea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:18.459838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:18.522267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aed89-f1ed-4561-ac24-f1d19d4fea65 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:18.593176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31999108-7177-4383-826a-929421465bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:18.593767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999108-7177-4383-826a-929421465bed service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:18.594043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999108-7177-4383-826a-929421465bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:18.594313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31999108-7177-4383-826a-929421465bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:18.595880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-31999108-7177-4383-826a-929421465bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:18.677314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:18.702999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999108-7177-4383-826a-929421465bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:18.705059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31999108-7177-4383-826a-929421465bed service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:18.723095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 497/1014] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:21.544622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977c5d-c1c7-45bd-941c-b0ad8a1d40a2 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:21.545127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977c5d-c1c7-45bd-941c-b0ad8a1d40a2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:21.545127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87977c5d-c1c7-45bd-941c-b0ad8a1d40a2 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:21.546442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 518/1015] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:21.551608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fd87a-f55c-4020-b086-2b1659908cd0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:21.552056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fd87a-f55c-4020-b086-2b1659908cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:21.552152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fd87a-f55c-4020-b086-2b1659908cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:21.617063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ed5fd87a-f55c-4020-b086-2b1659908cd0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:21.618244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ed5fd87a-f55c-4020-b086-2b1659908cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:21.714210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 498/1016] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:21.994904 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977c5d-c1c7-45bd-941c-b0ad8a1d40a2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:21.996460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-87977c5d-c1c7-45bd-941c-b0ad8a1d40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:22.070527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:22.097368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87977c5d-c1c7-45bd-941c-b0ad8a1d40a2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:22.170912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:22.171522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:22.171799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:22.172070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:22.173697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:22.279411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:22.280798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31b092-006d-4970-ab20-834eb9ab9e17 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:22.298594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 519/1017] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:26.692066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05739ca9-4af1-4340-b365-c89c0971624d None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:26.692601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05739ca9-4af1-4340-b365-c89c0971624d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:26.692695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05739ca9-4af1-4340-b365-c89c0971624d None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:26.694595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 499/1018] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:26.699837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d99dc-a0eb-49d8-9f73-3e04f51d81dc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:26.700245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d99dc-a0eb-49d8-9f73-3e04f51d81dc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:26.700429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d99dc-a0eb-49d8-9f73-3e04f51d81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:26.705997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:26.768766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6d1d99dc-a0eb-49d8-9f73-3e04f51d81dc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:26.769979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6d1d99dc-a0eb-49d8-9f73-3e04f51d81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:26.867236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 520/1019] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:27.152749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05739ca9-4af1-4340-b365-c89c0971624d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:27.154317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-05739ca9-4af1-4340-b365-c89c0971624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:27.204583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:27.259938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05739ca9-4af1-4340-b365-c89c0971624d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:27.335043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:27.335667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:27.336055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:27.336332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:27.337966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:27.432306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:27.448056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:27.449534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822d50-62c2-4eb7-9313-15873f5937c7 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:27.468349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 500/1020] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:30.560259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741bec-9748-43e4-8256-5c3aabac2d4d None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:30.560825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741bec-9748-43e4-8256-5c3aabac2d4d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:30.560825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf741bec-9748-43e4-8256-5c3aabac2d4d None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:30.562184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 521/1021] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:30.567570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac105-9958-42ac-b37d-77f17df4a254 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:30.568054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac105-9958-42ac-b37d-77f17df4a254 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:30.568157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ac105-9958-42ac-b37d-77f17df4a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:30.639394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e65ac105-9958-42ac-b37d-77f17df4a254 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:30.640627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e65ac105-9958-42ac-b37d-77f17df4a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:30.740960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 501/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:31.023160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741bec-9748-43e4-8256-5c3aabac2d4d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:31.024709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bf741bec-9748-43e4-8256-5c3aabac2d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:31.110412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:31.127433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf741bec-9748-43e4-8256-5c3aabac2d4d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:31.200363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:31.200993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:31.201269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:31.201539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:31.203109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:31.332468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:31.334216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f148-6353-4f5f-b35d-a0f9500c85ef service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:31.354414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 522/1023] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 02:59:35.720230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161892e-784a-4b73-9b2e-3dddba7909fd None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:35.720769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161892e-784a-4b73-9b2e-3dddba7909fd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:35.721062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161892e-784a-4b73-9b2e-3dddba7909fd None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:35.722739 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 502/1024] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:35.728895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dfa02-0d95-4e12-a80d-3b05164040f9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:35.729329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dfa02-0d95-4e12-a80d-3b05164040f9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:35.729452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4dfa02-0d95-4e12-a80d-3b05164040f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:35.746505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:35.797703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cd4dfa02-0d95-4e12-a80d-3b05164040f9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:35.799054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cd4dfa02-0d95-4e12-a80d-3b05164040f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:35.899415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 523/1025] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:36.180620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161892e-784a-4b73-9b2e-3dddba7909fd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:36.183507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8161892e-784a-4b73-9b2e-3dddba7909fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:36.242250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:36.289542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161892e-784a-4b73-9b2e-3dddba7909fd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:36.364263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:36.364662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:36.364966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:36.365241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:36.366856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:36.473576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:36.476853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:36.478297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae609aa4-e2d8-4824-a5c4-d087cceb8942 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:36.497100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 503/1026] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:41.458709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66fc8d-ae24-4e50-b07c-670dd9782ddc None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:41.459604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66fc8d-ae24-4e50-b07c-670dd9782ddc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:41.460094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66fc8d-ae24-4e50-b07c-670dd9782ddc None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:41.461793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 524/1027] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 02:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:41.468456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415b993-a030-41aa-9904-39ce635d5fa6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:41.468456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415b993-a030-41aa-9904-39ce635d5fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:41.468456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415b993-a030-41aa-9904-39ce635d5fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:41.555377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c415b993-a030-41aa-9904-39ce635d5fa6 None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:41.556594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c415b993-a030-41aa-9904-39ce635d5fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:41.750466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 504/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 02:59:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:45.897879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=59 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:45.927481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23867411-70d7-4cdc-bc50-b1a7016e5d28 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:45.927985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23867411-70d7-4cdc-bc50-b1a7016e5d28 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:45.928266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23867411-70d7-4cdc-bc50-b1a7016e5d28 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:45.929945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 525/1029] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 02:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:45.935247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbe802-609e-484c-8390-06491d96c46d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:45.935718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbe802-609e-484c-8390-06491d96c46d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:45.935802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbe802-609e-484c-8390-06491d96c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:45.993930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:46.016974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bdcbe802-609e-484c-8390-06491d96c46d None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:46.018178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bdcbe802-609e-484c-8390-06491d96c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:46.132876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 505/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 02:59:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:47.490953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b81f9-09ed-462d-a223-d1ae0cb75542 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:47.491501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b81f9-09ed-462d-a223-d1ae0cb75542 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:47.491501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b81f9-09ed-462d-a223-d1ae0cb75542 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:47.492879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 526/1031] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 02:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:47.498222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b919f0-e9fe-43b8-b7f0-81b3a4cfa1ed None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:47.498673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b919f0-e9fe-43b8-b7f0-81b3a4cfa1ed None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:47.498779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b919f0-e9fe-43b8-b7f0-81b3a4cfa1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:47.575778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-61b919f0-e9fe-43b8-b7f0-81b3a4cfa1ed None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:47.577004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-61b919f0-e9fe-43b8-b7f0-81b3a4cfa1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:47.620238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:47.698345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 506/1032] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 02:59:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 02:59:51.075525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79012-15fe-46fc-8420-4d33ad87e278 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:51.076067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79012-15fe-46fc-8420-4d33ad87e278 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:51.076067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79012-15fe-46fc-8420-4d33ad87e278 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:51.077770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 527/1033] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:51.083458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f25c2-9862-4251-886b-a346057743eb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:51.090921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f25c2-9862-4251-886b-a346057743eb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:51.090921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f25c2-9862-4251-886b-a346057743eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:51.161591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-740f25c2-9862-4251-886b-a346057743eb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:51.162950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-740f25c2-9862-4251-886b-a346057743eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:51.265544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 507/1034] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:51.565853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ed355-332b-4f7b-92f2-2da6a3727b4f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:51.570078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ed355-332b-4f7b-92f2-2da6a3727b4f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:51.570078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ed355-332b-4f7b-92f2-2da6a3727b4f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:51.570078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 528/1035] 10.222.0.13 () {54 vars in 961 bytes} [Fri Oct 14 02:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:51.576837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a1b1-1582-4801-8471-c47c09f57881 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:51.577428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a1b1-1582-4801-8471-c47c09f57881 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:51.577872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9a1b1-1582-4801-8471-c47c09f57881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:51.595627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:51.658760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1ae9a1b1-1582-4801-8471-c47c09f57881 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:51.660212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1ae9a1b1-1582-4801-8471-c47c09f57881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:51.803068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 508/1036] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Oct 14 02:59:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:51.810828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ed355-332b-4f7b-92f2-2da6a3727b4f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:51.812590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ad5ed355-332b-4f7b-92f2-2da6a3727b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:51.969450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ed355-332b-4f7b-92f2-2da6a3727b4f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:52.047759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:52.087995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:52.088643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:52.088900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:52.089173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:52.090769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:52.199391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:52.201203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b3816-60b6-4bc6-8bcd-bb055a933905 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:52.233726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 529/1037] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:54.619290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ee2cf-4fa8-4ca5-a673-a8b26a92d269 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:54.619290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ee2cf-4fa8-4ca5-a673-a8b26a92d269 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:54.620048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ee2cf-4fa8-4ca5-a673-a8b26a92d269 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:54.625172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 509/1038] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:54.626256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfe5ef-2bbe-459e-8f47-38ed728dddc5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:54.626710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfe5ef-2bbe-459e-8f47-38ed728dddc5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:54.626710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfe5ef-2bbe-459e-8f47-38ed728dddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:54.714613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-eacfe5ef-2bbe-459e-8f47-38ed728dddc5 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:54.715815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eacfe5ef-2bbe-459e-8f47-38ed728dddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:54.761403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:54.823236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 530/1039] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 02:59:55.116103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ee2cf-4fa8-4ca5-a673-a8b26a92d269 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:55.117496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-669ee2cf-4fa8-4ca5-a673-a8b26a92d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:55.187877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:55.293457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ee2cf-4fa8-4ca5-a673-a8b26a92d269 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:55.416858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:55.417466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:55.417749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:55.418020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:55.419653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:55.442830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:55.519311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:55.521470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5840d9-81bc-4eaf-be4a-1826dbac2c40 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:55.540751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 510/1040] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:58.149490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937549-8f60-43ee-b578-dee6948e6db0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:58.150022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937549-8f60-43ee-b578-dee6948e6db0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:58.150022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937549-8f60-43ee-b578-dee6948e6db0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:58.151376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 531/1041] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:58.156851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c329-dd78-4f78-88b7-0ea364ffef76 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:58.157259 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c329-dd78-4f78-88b7-0ea364ffef76 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:58.157429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c329-dd78-4f78-88b7-0ea364ffef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:58.227197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3568c329-dd78-4f78-88b7-0ea364ffef76 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:58.228422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3568c329-dd78-4f78-88b7-0ea364ffef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:58.328346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:58.332424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 511/1042] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:58.626096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771974-2f47-4a15-bd36-42be99dd6a0b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:58.626633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771974-2f47-4a15-bd36-42be99dd6a0b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:58.627068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9771974-2f47-4a15-bd36-42be99dd6a0b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:58.629415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 532/1043] 10.222.0.13 () {54 vars in 961 bytes} [Fri Oct 14 02:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:58.635791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c584072-0504-4f20-aeea-bc64b097d9c8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:58.636265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c584072-0504-4f20-aeea-bc64b097d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:58.636738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c584072-0504-4f20-aeea-bc64b097d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:58.718362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6c584072-0504-4f20-aeea-bc64b097d9c8 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:58.719819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6c584072-0504-4f20-aeea-bc64b097d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:58.843109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 512/1044] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Oct 14 02:59:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:58.850897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9771974-2f47-4a15-bd36-42be99dd6a0b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:58.852579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e9771974-2f47-4a15-bd36-42be99dd6a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:59.007211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9771974-2f47-4a15-bd36-42be99dd6a0b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 02:59:59.028118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:59.129906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 02:59:59.131083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:59.131462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:59.131842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:59.133728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:59.230692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 02:59:59.233354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467af6d2-4da4-4119-aa02-9871623d5f77 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 02:59:59.236501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fba73-a010-41bb-a0db-3e51e02dc4c1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:59.236908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fba73-a010-41bb-a0db-3e51e02dc4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:59.237061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fba73-a010-41bb-a0db-3e51e02dc4c1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:59.239210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 513/1045] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 02:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 02:59:59.244325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85423c3-1712-4467-9f50-9abc6e0eee33 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:59.244669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85423c3-1712-4467-9f50-9abc6e0eee33 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:59.244954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85423c3-1712-4467-9f50-9abc6e0eee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:59.255774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 533/1046] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 02:59:59.305702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:59.314980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c85423c3-1712-4467-9f50-9abc6e0eee33 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:59.314980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c85423c3-1712-4467-9f50-9abc6e0eee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:59.420540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 514/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 02:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:59.762023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac926-c019-4478-9250-e6bc6667fba3 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:59.762318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac926-c019-4478-9250-e6bc6667fba3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:59.762598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac926-c019-4478-9250-e6bc6667fba3 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:59.763958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 534/1048] 10.222.0.13 () {54 vars in 963 bytes} [Fri Oct 14 02:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 02:59:59.769698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c860-d3f8-4337-a43c-af91ccc740f7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 02:59:59.770074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c860-d3f8-4337-a43c-af91ccc740f7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 02:59:59.770443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c860-d3f8-4337-a43c-af91ccc740f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 02:59:59.850141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3da4c860-d3f8-4337-a43c-af91ccc740f7 None None] MFA Rules not processed for user `531145399f98493daef67bc1aa803a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 02:59:59.851358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3da4c860-d3f8-4337-a43c-af91ccc740f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:59.929083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 02:59:59.937281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 515/1049] 10.222.0.13 () {58 vars in 1060 bytes} [Fri Oct 14 02:59:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 02:59:59.945660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac926-c019-4478-9250-e6bc6667fba3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 02:59:59.947312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-84eac926-c019-4478-9250-e6bc6667fba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 02:59:59.978885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:00.060938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac926-c019-4478-9250-e6bc6667fba3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:00.148478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:00.149125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:00.149472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:00.149823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:00.151482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:00.243734 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:00.282242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:00.283720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48c6ba-7fbf-4f43-a576-841967872cec service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:00.309444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 535/1050] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 02:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:00:01.679796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a34d7-847d-4051-a5e5-1cf21498a86c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:01.680197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a34d7-847d-4051-a5e5-1cf21498a86c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:01.680355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a34d7-847d-4051-a5e5-1cf21498a86c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:01.681734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 516/1051] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:01.687247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137f5e5-52d3-46f1-a24d-1ddca6f272a9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:01.687664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137f5e5-52d3-46f1-a24d-1ddca6f272a9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:01.687793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137f5e5-52d3-46f1-a24d-1ddca6f272a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:01.758406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b137f5e5-52d3-46f1-a24d-1ddca6f272a9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:01.759630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b137f5e5-52d3-46f1-a24d-1ddca6f272a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:01.859066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 536/1052] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:02.153753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a34d7-847d-4051-a5e5-1cf21498a86c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:02.155347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d34a34d7-847d-4051-a5e5-1cf21498a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:02.308946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a34d7-847d-4051-a5e5-1cf21498a86c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:02.377561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:02.427876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:02.428975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:02.429651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:02.429927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:02.431543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:02.528087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:02.529748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed26492-5d24-48d0-986b-0a505833dadc service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:02.548220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 517/1053] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:04.916360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501c27-f7f3-4d18-acec-fb937d26a106 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:04.916921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501c27-f7f3-4d18-acec-fb937d26a106 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:04.916921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501c27-f7f3-4d18-acec-fb937d26a106 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:04.918447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 537/1054] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:04.923646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081c7a-e2d0-47a8-95b6-aff89358a68c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:04.924055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081c7a-e2d0-47a8-95b6-aff89358a68c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:04.924260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081c7a-e2d0-47a8-95b6-aff89358a68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:04.992197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7e081c7a-e2d0-47a8-95b6-aff89358a68c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:04.993418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7e081c7a-e2d0-47a8-95b6-aff89358a68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:05.024947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:05.100439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 518/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:05.384417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501c27-f7f3-4d18-acec-fb937d26a106 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:05.386112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-24501c27-f7f3-4d18-acec-fb937d26a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:05.426943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:05.547751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501c27-f7f3-4d18-acec-fb937d26a106 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:05.672181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:05.676240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:05.676883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:05.677160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:05.677429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:05.679520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:05.779541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:05.781180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5094c3-3e5e-440e-8d11-24eb3b3b8d43 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:05.801783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 538/1056] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:08.142790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1662624-cd78-4452-8b1b-f4ae9b8fb4e5 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:08.143354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1662624-cd78-4452-8b1b-f4ae9b8fb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:08.143354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1662624-cd78-4452-8b1b-f4ae9b8fb4e5 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:08.144813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 519/1057] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:08.150479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dbfc4-0e55-45d4-8411-dfbfed4604dd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:08.150918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dbfc4-0e55-45d4-8411-dfbfed4604dd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:08.151014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dbfc4-0e55-45d4-8411-dfbfed4604dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:08.226438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cb3dbfc4-0e55-45d4-8411-dfbfed4604dd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:08.227687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb3dbfc4-0e55-45d4-8411-dfbfed4604dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:08.311070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:08.348738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 539/1058] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:08.650761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1662624-cd78-4452-8b1b-f4ae9b8fb4e5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:08.652414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a1662624-cd78-4452-8b1b-f4ae9b8fb4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:08.804971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1662624-cd78-4452-8b1b-f4ae9b8fb4e5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:08.818198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:08.918867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:08.919396 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:08.919672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:08.919946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:08.921590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:09.014113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:09.015805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5e87b-bbc6-4e88-94fe-007dfe365361 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:09.035745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 520/1059] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:11.376039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477baa-c516-455e-bf25-3fb6487c05d0 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:11.376622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477baa-c516-455e-bf25-3fb6487c05d0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:11.376622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f477baa-c516-455e-bf25-3fb6487c05d0 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:11.377968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 540/1060] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:11.385114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a141fa-563a-44fe-a00d-2016c3b7ba3b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:11.385562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a141fa-563a-44fe-a00d-2016c3b7ba3b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:11.385679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a141fa-563a-44fe-a00d-2016c3b7ba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:11.410463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:11.460215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-39a141fa-563a-44fe-a00d-2016c3b7ba3b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:11.461939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-39a141fa-563a-44fe-a00d-2016c3b7ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:11.564507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 521/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:00:11.931743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477baa-c516-455e-bf25-3fb6487c05d0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:11.933398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4f477baa-c516-455e-bf25-3fb6487c05d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:12.085099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f477baa-c516-455e-bf25-3fb6487c05d0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:12.145731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:12.208347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:12.209037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:12.209347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:12.209651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:12.211493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:12.313586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:12.316205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea98f8-0a12-4f09-bec5-1f7d7f75a180 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:12.339068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 541/1062] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:14.538532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfa279-6e21-437b-b11e-46c6efb85c5c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:14.539177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfa279-6e21-437b-b11e-46c6efb85c5c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:14.539177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfa279-6e21-437b-b11e-46c6efb85c5c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:14.540652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 522/1063] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:14.546384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d77ba-7a80-44bd-aeab-0ed3281da80f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:14.549278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d77ba-7a80-44bd-aeab-0ed3281da80f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:14.549278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d77ba-7a80-44bd-aeab-0ed3281da80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:14.620060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-be7d77ba-7a80-44bd-aeab-0ed3281da80f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:14.622177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be7d77ba-7a80-44bd-aeab-0ed3281da80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:14.631946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:14.726598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 542/1064] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:15.062560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfa279-6e21-437b-b11e-46c6efb85c5c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:15.064200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-56cfa279-6e21-437b-b11e-46c6efb85c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:15.162537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:15.217475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfa279-6e21-437b-b11e-46c6efb85c5c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:15.329926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:15.330534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:15.330814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:15.331112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:15.332729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:15.393741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:15.423486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:15.425786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67191f2-ad97-420f-b30b-0a7d8d7b448d service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:15.444111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 523/1065] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:15.904073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e5df-95dc-4979-bf81-dab22f43a322 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:15.904626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e5df-95dc-4979-bf81-dab22f43a322 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:15.904742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e5df-95dc-4979-bf81-dab22f43a322 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:15.905980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 543/1066] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:15.911759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05270b-ae08-422d-bfea-8c4b59d2b35c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:15.912198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05270b-ae08-422d-bfea-8c4b59d2b35c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:15.912338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05270b-ae08-422d-bfea-8c4b59d2b35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:15.977633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ef05270b-ae08-422d-bfea-8c4b59d2b35c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:15.978731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ef05270b-ae08-422d-bfea-8c4b59d2b35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:16.075916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 524/1067] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:16.381139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c4d74-b9e2-4cb6-9b9b-724ffb50076f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:16.381448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c4d74-b9e2-4cb6-9b9b-724ffb50076f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:16.381721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c4d74-b9e2-4cb6-9b9b-724ffb50076f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:16.383051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 544/1068] 10.222.0.13 () {54 vars in 962 bytes} [Fri Oct 14 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:16.388406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c2af8-e0a1-4a59-91a1-9788bf84a701 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:16.388771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c2af8-e0a1-4a59-91a1-9788bf84a701 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:16.389152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c2af8-e0a1-4a59-91a1-9788bf84a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:16.434495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:16.465218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7f9c2af8-e0a1-4a59-91a1-9788bf84a701 None None] MFA Rules not processed for user `921d9ef4dcf94699b5708747fbe0146f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:16.466419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7f9c2af8-e0a1-4a59-91a1-9788bf84a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:16.544949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 525/1069] 10.222.0.13 () {58 vars in 1059 bytes} [Fri Oct 14 03:00:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:16.554693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c4d74-b9e2-4cb6-9b9b-724ffb50076f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:16.556218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-797c4d74-b9e2-4cb6-9b9b-724ffb50076f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:16.661725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c4d74-b9e2-4cb6-9b9b-724ffb50076f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:16.702060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:16.738535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:16.739142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:16.739443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:16.739720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:16.741356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:16.849453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:16.850892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb4485-d29a-433d-a4fc-840ddc0201ba service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:16.870677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 545/1070] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:17.810605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a455d92-1b41-4f1d-886a-a7025b74dc8b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:17.811033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a455d92-1b41-4f1d-886a-a7025b74dc8b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:17.811523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a455d92-1b41-4f1d-886a-a7025b74dc8b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:17.816582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 526/1071] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:17.818692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567e893-8161-43e4-a11e-c39bee3810b9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:17.819175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567e893-8161-43e4-a11e-c39bee3810b9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:17.819289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567e893-8161-43e4-a11e-c39bee3810b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:17.819383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833452-a38f-433a-8a7d-82a4b0ec53eb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:17.819587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833452-a38f-433a-8a7d-82a4b0ec53eb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:17.819866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb833452-a38f-433a-8a7d-82a4b0ec53eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:17.898103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-eb833452-a38f-433a-8a7d-82a4b0ec53eb None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:17.899302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-eb833452-a38f-433a-8a7d-82a4b0ec53eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:17.899918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5567e893-8161-43e4-a11e-c39bee3810b9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:17.901100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5567e893-8161-43e4-a11e-c39bee3810b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:17.948165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:17.979347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:17.988458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 527/1072] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:00:18.042264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 546/1073] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:18.042891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1968-552c-499f-b091-bb9bf48c21db None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:18.042891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1968-552c-499f-b091-bb9bf48c21db None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:18.042891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1968-552c-499f-b091-bb9bf48c21db None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:18.042891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 528/1074] 10.222.0.13 () {54 vars in 943 bytes} [Fri Oct 14 03:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:18.048373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:18.048699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:18.048980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:18.126929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] MFA Rules not processed for user `972095d3e6cb4472b1c465a780138806`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:18.128134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:18.235750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 547/1075] 10.222.0.13 () {58 vars in 1040 bytes} [Fri Oct 14 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:18.242888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:18.245245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1968-552c-499f-b091-bb9bf48c21db None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:18.246782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e31d1968-552c-499f-b091-bb9bf48c21db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:18.313686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:18.314897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:18.388611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1968-552c-499f-b091-bb9bf48c21db None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:18.414255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d4f6f-acaf-455f-b229-4366bbe0e324 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:18.467153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:18.494428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:18.495100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:18.495379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:18.495651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:18.497454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:18.523562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:18.535121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:18.535745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:18.536029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:18.536313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:18.537984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:18.582274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:18.583874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe8881-6586-4ac1-89b0-dc48184f0d06 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:18.592072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 529/1076] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:00:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:00:18.630912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:18.632531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87457b-aa7e-47f9-9eb0-a93dec64e6e5 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:18.650344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 548/1077] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:20.951080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70499e9c-8d07-4e96-928c-1dbc8072df7c None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:20.951621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70499e9c-8d07-4e96-928c-1dbc8072df7c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:20.951621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70499e9c-8d07-4e96-928c-1dbc8072df7c None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:20.953210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 530/1078] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:20.961070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e06e4c-252c-4b30-b4a0-193c4f746d39 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:20.961070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e06e4c-252c-4b30-b4a0-193c4f746d39 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:20.961070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e06e4c-252c-4b30-b4a0-193c4f746d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:21.028579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a6e06e4c-252c-4b30-b4a0-193c4f746d39 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:21.029800 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a6e06e4c-252c-4b30-b4a0-193c4f746d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:21.101886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:21.142389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 549/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:21.433931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70499e9c-8d07-4e96-928c-1dbc8072df7c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:21.435615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-70499e9c-8d07-4e96-928c-1dbc8072df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:21.559628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:21.602808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70499e9c-8d07-4e96-928c-1dbc8072df7c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:21.736637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:21.737988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:21.738270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:21.738540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:21.740191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:21.833995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:21.854548 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:21.856174 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94845e-3134-413c-ba42-509aa1519ae4 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:21.877365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 531/1080] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:24.239135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679372-3280-4b66-b306-c209fbee2074 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:24.239682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679372-3280-4b66-b306-c209fbee2074 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:24.239682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3679372-3280-4b66-b306-c209fbee2074 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:24.241395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 550/1081] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:24.246706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fc7a-5c49-4ddc-91fa-bdca034e8f3f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:24.247171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fc7a-5c49-4ddc-91fa-bdca034e8f3f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:24.247374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6fc7a-5c49-4ddc-91fa-bdca034e8f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:24.320241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e5a6fc7a-5c49-4ddc-91fa-bdca034e8f3f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:24.321481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e5a6fc7a-5c49-4ddc-91fa-bdca034e8f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:24.428567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 532/1082] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:24.723057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3679372-3280-4b66-b306-c209fbee2074 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:24.724624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f3679372-3280-4b66-b306-c209fbee2074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:24.894509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3679372-3280-4b66-b306-c209fbee2074 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:24.950575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:25.026211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:25.026822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:25.027101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:25.027369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:25.029046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:25.126691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:25.128864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91925-f798-4866-b0ae-b29bb1829b47 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:25.148268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 551/1083] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:27.445782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be44d-64f5-4214-be81-fe8791245bab None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:27.446431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be44d-64f5-4214-be81-fe8791245bab None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:27.446431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be44d-64f5-4214-be81-fe8791245bab None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:27.447890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 533/1084] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:27.453072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57a512-c954-4178-8932-32976c3129df None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:27.453488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57a512-c954-4178-8932-32976c3129df None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:27.453650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57a512-c954-4178-8932-32976c3129df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:27.526756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0a57a512-c954-4178-8932-32976c3129df None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:27.528118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0a57a512-c954-4178-8932-32976c3129df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:27.531103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:27.636268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 552/1085] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:27.927715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263be44d-64f5-4214-be81-fe8791245bab None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:27.929282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-263be44d-64f5-4214-be81-fe8791245bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:27.997405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:28.087851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263be44d-64f5-4214-be81-fe8791245bab None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:28.219071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:28.219698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:28.219964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:28.220236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:28.222409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:28.244353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:28.349825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:28.349825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b74934-af0c-4695-bc1a-ab2408b15f17 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:28.380445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 534/1086] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:37.633835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=41 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:38.367213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=37 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:42.558375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562abb46-1e4a-46ea-9c44-5878afe93c55 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:42.558892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562abb46-1e4a-46ea-9c44-5878afe93c55 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:42.558892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562abb46-1e4a-46ea-9c44-5878afe93c55 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:42.560195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 553/1087] 10.222.0.13 () {54 vars in 918 bytes} [Fri Oct 14 03:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:42.565394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce1d86-80f1-43f8-a725-a96234d4909c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:42.565845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce1d86-80f1-43f8-a725-a96234d4909c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:42.565941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce1d86-80f1-43f8-a725-a96234d4909c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:42.640250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f7ce1d86-80f1-43f8-a725-a96234d4909c None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:42.641504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f7ce1d86-80f1-43f8-a725-a96234d4909c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:42.747210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 535/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Oct 14 03:00:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:42.761395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a1b9-6eba-4d3d-bcab-7beceed6e135 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:42.761682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a1b9-6eba-4d3d-bcab-7beceed6e135 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:42.761956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a1b9-6eba-4d3d-bcab-7beceed6e135 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:42.763344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 554/1089] 10.222.0.13 () {54 vars in 918 bytes} [Fri Oct 14 03:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:42.768442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e21e-e1e2-4d1c-a90e-6decbe88e4b4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:42.768728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e21e-e1e2-4d1c-a90e-6decbe88e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:42.769001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e21e-e1e2-4d1c-a90e-6decbe88e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:42.840744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:42.843349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ed48e21e-e1e2-4d1c-a90e-6decbe88e4b4 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:42.844586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ed48e21e-e1e2-4d1c-a90e-6decbe88e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:42.959647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 536/1090] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Oct 14 03:00:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:45.536798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfac548-10d2-4263-bc20-0e00f0bf42e9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:45.537338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfac548-10d2-4263-bc20-0e00f0bf42e9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:45.537338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfac548-10d2-4263-bc20-0e00f0bf42e9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:45.538701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 555/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:45.544076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484bf53-1af5-4db3-abb1-a87285966bdd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:45.544499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484bf53-1af5-4db3-abb1-a87285966bdd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:45.544654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484bf53-1af5-4db3-abb1-a87285966bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:45.610494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2484bf53-1af5-4db3-abb1-a87285966bdd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:45.612207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2484bf53-1af5-4db3-abb1-a87285966bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:45.665220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:45.706711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 537/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:45.993823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfac548-10d2-4263-bc20-0e00f0bf42e9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:45.995336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6bfac548-10d2-4263-bc20-0e00f0bf42e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:46.139312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfac548-10d2-4263-bc20-0e00f0bf42e9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:46.211735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:46.251139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:46.253231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:46.253231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:46.253231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:46.254330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:46.342774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:46.344409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3161-12a7-4bd5-873f-348ef446c331 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:46.362612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 556/1093] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:47.499854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa753a-4000-41dd-869b-15fce91fdab1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:47.500471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa753a-4000-41dd-869b-15fce91fdab1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:47.500471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa753a-4000-41dd-869b-15fce91fdab1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:47.502406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 538/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:47.508667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045f7a-e520-48e6-a3d6-e34b042f9860 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:47.509093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045f7a-e520-48e6-a3d6-e34b042f9860 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:47.509580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045f7a-e520-48e6-a3d6-e34b042f9860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:47.583475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1c045f7a-e520-48e6-a3d6-e34b042f9860 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:47.584704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c045f7a-e520-48e6-a3d6-e34b042f9860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:47.611734 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:47.681914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 557/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:47.837622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa753a-4000-41dd-869b-15fce91fdab1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:47.839044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-34aa753a-4000-41dd-869b-15fce91fdab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:47.983222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa753a-4000-41dd-869b-15fce91fdab1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:48.023928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:48.095770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:48.096292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:48.096598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:48.096868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:48.098449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:48.185808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:48.187402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1a7cb-f084-4569-a0d2-c8d69e839537 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:48.205329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 539/1096] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:49.323012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c772a4-5399-4a02-8a06-dac07ebecd39 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:49.323589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c772a4-5399-4a02-8a06-dac07ebecd39 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:49.323589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c772a4-5399-4a02-8a06-dac07ebecd39 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:49.324967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 558/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:49.331512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13c06-8f53-4d70-baa3-52f61a0b3a88 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:49.331924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13c06-8f53-4d70-baa3-52f61a0b3a88 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:49.332039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13c06-8f53-4d70-baa3-52f61a0b3a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:49.386771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:49.408139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c7a13c06-8f53-4d70-baa3-52f61a0b3a88 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:49.409368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c7a13c06-8f53-4d70-baa3-52f61a0b3a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:49.504129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 540/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:49.665178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c772a4-5399-4a02-8a06-dac07ebecd39 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:49.666700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-52c772a4-5399-4a02-8a06-dac07ebecd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:49.814058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c772a4-5399-4a02-8a06-dac07ebecd39 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:49.826377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:49.927074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:49.927596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:49.927874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:49.928143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:49.929766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:50.017835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:50.019417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f87ef0-4e32-45e5-85a1-92b5b638cd20 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:50.038418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 559/1099] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:51.142309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f215e-c41c-4bbd-8bd1-d351493708f1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:51.142919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f215e-c41c-4bbd-8bd1-d351493708f1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:51.142919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f215e-c41c-4bbd-8bd1-d351493708f1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:51.144215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 541/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:51.150589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c4c1-6e40-416a-949b-265a105496cb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:51.155157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c4c1-6e40-416a-949b-265a105496cb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:51.155157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69c4c1-6e40-416a-949b-265a105496cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:51.171208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:51.227338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bf69c4c1-6e40-416a-949b-265a105496cb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:51.228609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bf69c4c1-6e40-416a-949b-265a105496cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:51.321246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 560/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:51.471587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f215e-c41c-4bbd-8bd1-d351493708f1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:51.473131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-108f215e-c41c-4bbd-8bd1-d351493708f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:51.581454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:51.616783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f215e-c41c-4bbd-8bd1-d351493708f1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:51.729025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:51.729557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:51.729836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:51.730371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:51.731982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:51.812996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:51.826939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:51.828572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72178e5e-03ce-42ed-bbeb-1dfcd786b119 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:51.846149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 542/1102] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:52.949287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1941a-25e1-405d-8b09-807fefeff1f8 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:52.949860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1941a-25e1-405d-8b09-807fefeff1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:52.949860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1941a-25e1-405d-8b09-807fefeff1f8 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:52.951175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 561/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:52.957770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e951a-e191-4092-b248-bd44487c69d8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:52.958238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e951a-e191-4092-b248-bd44487c69d8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:52.958363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e951a-e191-4092-b248-bd44487c69d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:53.033271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6e6e951a-e191-4092-b248-bd44487c69d8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:53.034450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6e6e951a-e191-4092-b248-bd44487c69d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:53.131836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 543/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:53.282690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1941a-25e1-405d-8b09-807fefeff1f8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:53.284159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3bf1941a-25e1-405d-8b09-807fefeff1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:53.368353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:53.429315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1941a-25e1-405d-8b09-807fefeff1f8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:53.540481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:53.541031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:53.541311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:53.541580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:53.543216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:53.590655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:53.632243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:53.633924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f89707-e58b-463b-a1b7-10978aff0570 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:53.652215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 562/1105] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:54.773005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303377d-e75e-40b5-a670-984c53d0a0be None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:54.773573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303377d-e75e-40b5-a670-984c53d0a0be None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:54.773573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303377d-e75e-40b5-a670-984c53d0a0be None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:54.774917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 544/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:54.780984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfedbcf-53a2-4299-86d4-87369cd78423 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:54.781404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfedbcf-53a2-4299-86d4-87369cd78423 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:54.781528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfedbcf-53a2-4299-86d4-87369cd78423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:54.855616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ddfedbcf-53a2-4299-86d4-87369cd78423 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:54.856836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ddfedbcf-53a2-4299-86d4-87369cd78423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:54.950197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 563/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:55.098697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303377d-e75e-40b5-a670-984c53d0a0be None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:55.100242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2303377d-e75e-40b5-a670-984c53d0a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:55.149652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:55.243864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303377d-e75e-40b5-a670-984c53d0a0be None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:55.354538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:55.355395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:55.355676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:55.355949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:55.357585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:55.364449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:55.446479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:55.448051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e086f-c065-4378-b6b3-69cfc607b30b service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:55.465743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 545/1108] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:56.580873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f0ad-887e-4289-9e8e-c4fbbfc39622 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:56.581421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f0ad-887e-4289-9e8e-c4fbbfc39622 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:56.581421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f0ad-887e-4289-9e8e-c4fbbfc39622 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:56.582766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 564/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:56.589257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c2d2-5147-4927-b107-ae3d4963416a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:56.589689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c2d2-5147-4927-b107-ae3d4963416a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:56.589817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3c2d2-5147-4927-b107-ae3d4963416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:56.665767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cdb3c2d2-5147-4927-b107-ae3d4963416a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:56.666955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cdb3c2d2-5147-4927-b107-ae3d4963416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:56.733352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:56.761169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 546/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:56.909041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f0ad-887e-4289-9e8e-c4fbbfc39622 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:56.910470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-07e1f0ad-887e-4289-9e8e-c4fbbfc39622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:56.927466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:57.053772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f0ad-887e-4289-9e8e-c4fbbfc39622 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:57.139848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:57.166393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:57.166393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:57.166393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:57.166393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:57.166975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:57.254504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:57.256082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305029ee-80b6-4649-a01f-389c88c50d58 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:57.273648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 565/1111] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:00:58.393043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c4a2-54da-4c4a-940a-7319b1c70aac None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:58.393600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c4a2-54da-4c4a-940a-7319b1c70aac None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:58.393600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555c4a2-54da-4c4a-940a-7319b1c70aac None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:58.394918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 547/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:00:58.401010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c9bbe-2d10-463d-8684-1e65c9fe57fb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:58.401418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c9bbe-2d10-463d-8684-1e65c9fe57fb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:58.401582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c9bbe-2d10-463d-8684-1e65c9fe57fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:58.476110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-100c9bbe-2d10-463d-8684-1e65c9fe57fb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:00:58.477256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-100c9bbe-2d10-463d-8684-1e65c9fe57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:58.518166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:58.572568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 566/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:00:58.723055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555c4a2-54da-4c4a-940a-7319b1c70aac None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:00:58.724619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6555c4a2-54da-4c4a-940a-7319b1c70aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:58.867481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555c4a2-54da-4c4a-940a-7319b1c70aac None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:00:58.919896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:00:58.977342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:00:58.977944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:00:58.978225 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:00:58.978497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:00:58.980349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:00:59.068997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:00:59.070601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c7cfa-d623-4654-ac9d-3554ad2aa48a service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:00:59.088134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 548/1114] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:00.186898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364a75a-e9ec-4c8c-a882-0e653996fe98 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:00.187479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364a75a-e9ec-4c8c-a882-0e653996fe98 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:00.187479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364a75a-e9ec-4c8c-a882-0e653996fe98 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:00.188845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 567/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:00.195178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561bfc7-c4cb-4549-a705-4918b41f0e39 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:00.195683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561bfc7-c4cb-4549-a705-4918b41f0e39 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:00.195779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561bfc7-c4cb-4549-a705-4918b41f0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:00.271329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7561bfc7-c4cb-4549-a705-4918b41f0e39 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:00.272553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7561bfc7-c4cb-4549-a705-4918b41f0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:00.274537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:00.368795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 549/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:00.528673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364a75a-e9ec-4c8c-a882-0e653996fe98 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:00.528673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9364a75a-e9ec-4c8c-a882-0e653996fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:00.669823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364a75a-e9ec-4c8c-a882-0e653996fe98 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:00.698003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:00.781800 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:00.782326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:00.782605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:00.782875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:00.784503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:00.871294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:00.872894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304b4ad-73b7-423f-b8c0-231f29bf09dd service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:00.890908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 568/1117] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:02.918858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692406b5-8747-43e7-bc49-d1ebe3420083 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:02.919389 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692406b5-8747-43e7-bc49-d1ebe3420083 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:02.919389 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692406b5-8747-43e7-bc49-d1ebe3420083 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:02.920766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 550/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:02.926099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13898-41a4-4e19-87ac-6a9e3e768535 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:02.926548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13898-41a4-4e19-87ac-6a9e3e768535 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:02.926652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e13898-41a4-4e19-87ac-6a9e3e768535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:02.967432 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:02.992517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-39e13898-41a4-4e19-87ac-6a9e3e768535 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:02.993724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-39e13898-41a4-4e19-87ac-6a9e3e768535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:03.089217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 569/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:03.373872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692406b5-8747-43e7-bc49-d1ebe3420083 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:03.375432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-692406b5-8747-43e7-bc49-d1ebe3420083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:03.476572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692406b5-8747-43e7-bc49-d1ebe3420083 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:03.508882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:03.549513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:03.550116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:03.550398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:03.550671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:03.552277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:03.661596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:03.662975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96220686-0b22-4d1b-bd09-09fc7f6ab960 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:03.681871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 551/1120] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:05.971046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82243f-08a4-4260-89d0-33932c44617e None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:05.971558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82243f-08a4-4260-89d0-33932c44617e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:05.971558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82243f-08a4-4260-89d0-33932c44617e None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:05.972885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 570/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 03:01:05.978153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888dd1-8423-49f8-86ec-5d75f2ded30c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:05.978559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888dd1-8423-49f8-86ec-5d75f2ded30c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:05.978700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f888dd1-8423-49f8-86ec-5d75f2ded30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:06.043771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3f888dd1-8423-49f8-86ec-5d75f2ded30c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:06.044984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3f888dd1-8423-49f8-86ec-5d75f2ded30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:06.058206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:06.143025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 552/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:06.430706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82243f-08a4-4260-89d0-33932c44617e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:06.432229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-de82243f-08a4-4260-89d0-33932c44617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:06.534223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82243f-08a4-4260-89d0-33932c44617e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:06.547687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:06.607697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:06.608305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:06.608615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:06.608889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:06.611026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:06.719172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:06.720563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a0617-13c3-4ce5-9063-38f56deefb93 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:06.738728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 571/1123] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:09.246515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3cff6-56b5-4598-83c2-d651ef9e31c0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:09.247077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3cff6-56b5-4598-83c2-d651ef9e31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:09.247077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3cff6-56b5-4598-83c2-d651ef9e31c0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:09.248405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 553/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:09.254198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17bf6-4d13-4500-9cc5-116c2eb4cb19 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:09.254642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17bf6-4d13-4500-9cc5-116c2eb4cb19 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:09.254759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c17bf6-4d13-4500-9cc5-116c2eb4cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:09.301735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:09.319442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-72c17bf6-4d13-4500-9cc5-116c2eb4cb19 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:09.320695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-72c17bf6-4d13-4500-9cc5-116c2eb4cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:09.414816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 572/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:09.700679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3cff6-56b5-4598-83c2-d651ef9e31c0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:09.702254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c8b3cff6-56b5-4598-83c2-d651ef9e31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:09.804663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3cff6-56b5-4598-83c2-d651ef9e31c0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:09.844982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:09.878506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:09.879110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:09.879392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:09.879665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:09.881324 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:09.993239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:09.994590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98228153-38b1-412f-89dd-fb1a78a35f24 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:10.013550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 554/1126] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:12.260235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd44-82d7-4620-aee1-5dce9eca943c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:12.260778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd44-82d7-4620-aee1-5dce9eca943c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:12.260881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ffd44-82d7-4620-aee1-5dce9eca943c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:12.262189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 573/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:12.267501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49616be-3497-4bf9-a8a5-ff7bd51c11ea None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:12.267875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49616be-3497-4bf9-a8a5-ff7bd51c11ea None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:12.268060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49616be-3497-4bf9-a8a5-ff7bd51c11ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:12.332278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f49616be-3497-4bf9-a8a5-ff7bd51c11ea None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:12.333495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f49616be-3497-4bf9-a8a5-ff7bd51c11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:12.353882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:12.429665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 555/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:12.714307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ffd44-82d7-4620-aee1-5dce9eca943c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:12.715829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-df7ffd44-82d7-4620-aee1-5dce9eca943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:12.818016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ffd44-82d7-4620-aee1-5dce9eca943c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:12.838646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:12.891516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:12.892113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:12.892411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:12.892676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:12.894262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:13.000913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:13.002266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667baf77-ca1a-4125-a80e-87eed64a393c service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:13.020074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 574/1129] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:15.199060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d9e6-27f4-4444-a233-e26cddc08f3b None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:15.199597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d9e6-27f4-4444-a233-e26cddc08f3b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:15.199597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d9e6-27f4-4444-a233-e26cddc08f3b None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:15.201008 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 556/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:15.206880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9cc3-19ff-46f9-9ab2-4d92561d32bc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:15.207279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9cc3-19ff-46f9-9ab2-4d92561d32bc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:15.207434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b9cc3-19ff-46f9-9ab2-4d92561d32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:15.270355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:15.272971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fb2b9cc3-19ff-46f9-9ab2-4d92561d32bc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:15.274179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fb2b9cc3-19ff-46f9-9ab2-4d92561d32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:15.369853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 575/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:15.653164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d9e6-27f4-4444-a233-e26cddc08f3b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:15.654706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cb02d9e6-27f4-4444-a233-e26cddc08f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:15.758217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d9e6-27f4-4444-a233-e26cddc08f3b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:15.805967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:15.830420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:15.831247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:15.831695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:15.832270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:15.833915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:15.940710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:15.942070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1b13c-9815-4f12-ac73-cb4e8aaa1cdb service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:15.961357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 557/1132] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:18.151378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1fba-4874-4f9c-be57-d238e53319a4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:18.151948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1fba-4874-4f9c-be57-d238e53319a4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:18.151948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1fba-4874-4f9c-be57-d238e53319a4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:18.153333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 576/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:18.159437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1912d-3d68-4770-8575-3c8c68ee96d8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:18.159816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1912d-3d68-4770-8575-3c8c68ee96d8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:18.160034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1912d-3d68-4770-8575-3c8c68ee96d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:18.226354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6ad1912d-3d68-4770-8575-3c8c68ee96d8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:18.227571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6ad1912d-3d68-4770-8575-3c8c68ee96d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:18.256154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:18.322937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 558/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:18.613601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f1fba-4874-4f9c-be57-d238e53319a4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:18.615195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-223f1fba-4874-4f9c-be57-d238e53319a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:18.717894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f1fba-4874-4f9c-be57-d238e53319a4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:18.746224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:18.790888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:18.791490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:18.791769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:18.792041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:18.793675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:18.901655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:18.903007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b05a-61b6-4fa0-9e1a-f65a7f65d685 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:18.921357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 577/1135] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:21.110046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96e13-bf19-4d04-9784-e7ab2717b151 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:21.110644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96e13-bf19-4d04-9784-e7ab2717b151 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:21.110644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96e13-bf19-4d04-9784-e7ab2717b151 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:21.111930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 559/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:21.117217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8c4d0-3f70-4518-b018-d6dff6403ad7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:21.117640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8c4d0-3f70-4518-b018-d6dff6403ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:21.117774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8c4d0-3f70-4518-b018-d6dff6403ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:21.183595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c2b8c4d0-3f70-4518-b018-d6dff6403ad7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:21.184842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c2b8c4d0-3f70-4518-b018-d6dff6403ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:21.193035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:21.281127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 578/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:01:21.566668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96e13-bf19-4d04-9784-e7ab2717b151 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:21.568226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d9d96e13-bf19-4d04-9784-e7ab2717b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:21.669284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d96e13-bf19-4d04-9784-e7ab2717b151 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:21.724591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:21.743781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:21.744415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:21.744712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:21.744981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:21.746603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:21.854707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:21.856124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157a155-fa1b-4154-af0a-ca469e228a09 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:21.875802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 560/1138] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:24.064437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b451d3-beb4-49e9-9fd4-6a35269d3230 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:24.064968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b451d3-beb4-49e9-9fd4-6a35269d3230 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:24.064968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b451d3-beb4-49e9-9fd4-6a35269d3230 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:24.066262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 579/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:24.071536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24e71-312c-4d1a-8386-e873c9bb9f7e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:24.071974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24e71-312c-4d1a-8386-e873c9bb9f7e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:24.072082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24e71-312c-4d1a-8386-e873c9bb9f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:24.137101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a4d24e71-312c-4d1a-8386-e873c9bb9f7e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:24.138284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a4d24e71-312c-4d1a-8386-e873c9bb9f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:24.176465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:24.234488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 561/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:24.518077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b451d3-beb4-49e9-9fd4-6a35269d3230 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:24.519626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-88b451d3-beb4-49e9-9fd4-6a35269d3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:24.627105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b451d3-beb4-49e9-9fd4-6a35269d3230 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:24.664688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:24.700328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:24.700959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:24.701846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:24.702124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:24.703726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:24.809772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:24.811762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6c629-b424-4df6-8dd7-f5c92c271110 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:24.830459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 580/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:27.004262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7da450-ce56-477b-8e3f-126b82ef3a36 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:27.004850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7da450-ce56-477b-8e3f-126b82ef3a36 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:27.004850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7da450-ce56-477b-8e3f-126b82ef3a36 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:27.006103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 562/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:27.011374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21888-79d9-42d3-bf2d-830786e38b6d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:27.011801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21888-79d9-42d3-bf2d-830786e38b6d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:27.011920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c21888-79d9-42d3-bf2d-830786e38b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:27.075800 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-83c21888-79d9-42d3-bf2d-830786e38b6d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:27.077003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-83c21888-79d9-42d3-bf2d-830786e38b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:27.094595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:27.173017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 581/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:27.453308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7da450-ce56-477b-8e3f-126b82ef3a36 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:27.454880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1a7da450-ce56-477b-8e3f-126b82ef3a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:27.558060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7da450-ce56-477b-8e3f-126b82ef3a36 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:27.625142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:27.631476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:27.632106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:27.632397 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:27.632785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:27.634315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:27.743753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:27.745232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515cb9f-ce63-4090-8968-e73e8c8f075d service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:27.762913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 563/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:29.892976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ff91-5293-4d2a-a1c5-bbc0dcd7a978 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:29.893530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ff91-5293-4d2a-a1c5-bbc0dcd7a978 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:29.893530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ff91-5293-4d2a-a1c5-bbc0dcd7a978 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:29.894858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 582/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:29.900186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6f01-ac32-4661-bc4f-0f55092f11f0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:29.900613 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6f01-ac32-4661-bc4f-0f55092f11f0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:29.900776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6f01-ac32-4661-bc4f-0f55092f11f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:29.966729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ba7d6f01-ac32-4661-bc4f-0f55092f11f0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:29.967849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ba7d6f01-ac32-4661-bc4f-0f55092f11f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:30.015366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:30.065649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 564/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:30.346003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ff91-5293-4d2a-a1c5-bbc0dcd7a978 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:30.347602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1a11ff91-5293-4d2a-a1c5-bbc0dcd7a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:30.449521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ff91-5293-4d2a-a1c5-bbc0dcd7a978 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:30.496122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:30.521333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:30.521928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:30.522204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:30.522488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:30.524167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:30.633508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:30.635294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39278d-3a77-4201-b91f-b2b9ed405f72 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:30.655815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 583/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:40.064182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=22 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:40.653700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=66 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:50.456071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc64b-bd7a-4e37-83ce-eb4dc5270db6 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:50.456639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc64b-bd7a-4e37-83ce-eb4dc5270db6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:50.456639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc64b-bd7a-4e37-83ce-eb4dc5270db6 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:50.457985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 565/1148] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:50.463501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3f03-b96f-4997-99f3-06e5453bee5f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:50.463927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3f03-b96f-4997-99f3-06e5453bee5f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:50.464052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae3f03-b96f-4997-99f3-06e5453bee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:50.531188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-94ae3f03-b96f-4997-99f3-06e5453bee5f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:50.532363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-94ae3f03-b96f-4997-99f3-06e5453bee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:50.627402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 584/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:50.926986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a702b-ad87-4b91-a2be-bf86481a2293 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:50.927342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a702b-ad87-4b91-a2be-bf86481a2293 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:50.927618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a702b-ad87-4b91-a2be-bf86481a2293 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:50.929018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 566/1150] 10.222.0.13 () {54 vars in 962 bytes} [Fri Oct 14 03:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:50.933961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab420-a488-4c75-b4db-99b5e9cf1a18 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:50.934247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab420-a488-4c75-b4db-99b5e9cf1a18 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:50.934522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab420-a488-4c75-b4db-99b5e9cf1a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:51.010062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0c6ab420-a488-4c75-b4db-99b5e9cf1a18 None None] MFA Rules not processed for user `921d9ef4dcf94699b5708747fbe0146f`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:51.011339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0c6ab420-a488-4c75-b4db-99b5e9cf1a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:51.033193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:51.088542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 585/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Fri Oct 14 03:01:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:51.096918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a702b-ad87-4b91-a2be-bf86481a2293 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:51.098482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7e6a702b-ad87-4b91-a2be-bf86481a2293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:51.199997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a702b-ad87-4b91-a2be-bf86481a2293 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:51.273796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:51.274390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:51.274667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:51.274935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:51.276535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:51.329376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:51.382079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:51.383503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6b57f-0dd7-4623-9875-51dc70c7810b service glance] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:51.401711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 567/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:01:53.601816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22484c2-49c8-42db-ade5-41b317aedb5f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:53.602639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22484c2-49c8-42db-ade5-41b317aedb5f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:53.602639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22484c2-49c8-42db-ade5-41b317aedb5f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:53.604023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 586/1153] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:53.610106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff8f8-d529-4f6d-9719-2fcaabc71fa1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:53.610514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff8f8-d529-4f6d-9719-2fcaabc71fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:53.610673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff8f8-d529-4f6d-9719-2fcaabc71fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:53.677236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-118ff8f8-d529-4f6d-9719-2fcaabc71fa1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:53.678451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-118ff8f8-d529-4f6d-9719-2fcaabc71fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:53.773666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 568/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:54.043206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22484c2-49c8-42db-ade5-41b317aedb5f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:54.044726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f22484c2-49c8-42db-ade5-41b317aedb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:54.167807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22484c2-49c8-42db-ade5-41b317aedb5f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:54.217754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:54.261757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:54.262390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:54.262669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:54.262941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:54.263573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:54.264701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:01:54.264701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 03:01:54.264701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 03:01:54.265869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73159052-7bae-404d-91aa-5784e95d1b75 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:54.284779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 587/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Fri Oct 14 03:01:54 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:01:56.406018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753f2f0-84a3-4728-89ba-b201c296d675 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:56.406575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753f2f0-84a3-4728-89ba-b201c296d675 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:56.406575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753f2f0-84a3-4728-89ba-b201c296d675 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:56.407906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 569/1156] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:56.413046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca55b-2162-4c28-a19e-ffda1c7134bd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:56.413452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca55b-2162-4c28-a19e-ffda1c7134bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:56.413588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca55b-2162-4c28-a19e-ffda1c7134bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:56.477975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ee8ca55b-2162-4c28-a19e-ffda1c7134bd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:56.479167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ee8ca55b-2162-4c28-a19e-ffda1c7134bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:56.574103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 588/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:56.864074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753f2f0-84a3-4728-89ba-b201c296d675 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:56.865629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1753f2f0-84a3-4728-89ba-b201c296d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:56.875284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:57.008584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753f2f0-84a3-4728-89ba-b201c296d675 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:01:57.089022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:57.121029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:01:57.121595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:57.121875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:57.122147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:57.123789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:57.211704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:01:57.213320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759f554-1f1f-4b7c-a5a4-127b1d2eff3a service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:01:57.231374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 570/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:01:59.517445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59917cb8-75fa-4a9b-8a8b-773974caac3b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:59.523350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59917cb8-75fa-4a9b-8a8b-773974caac3b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:59.523350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59917cb8-75fa-4a9b-8a8b-773974caac3b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:59.523350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 589/1159] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:01:59.524526 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ad9f-f151-40c2-b329-bbc8f5aa5b7c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:01:59.524928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ad9f-f151-40c2-b329-bbc8f5aa5b7c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:01:59.525082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ad9f-f151-40c2-b329-bbc8f5aa5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:01:59.591705 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a717ad9f-f151-40c2-b329-bbc8f5aa5b7c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:01:59.592992 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a717ad9f-f151-40c2-b329-bbc8f5aa5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:01:59.639539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:01:59.689601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 571/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:01:59.979226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59917cb8-75fa-4a9b-8a8b-773974caac3b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:01:59.980801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-59917cb8-75fa-4a9b-8a8b-773974caac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:00.004531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:00.083722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59917cb8-75fa-4a9b-8a8b-773974caac3b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:02:00.159430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:02:00.160026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:00.160302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:00.160600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:00.162188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:00.235186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:00.269199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:02:00.270630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7113179-79c7-49ea-8347-dfa7f6051002 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:02:00.289068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 590/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:02:02.469562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2504-a453-4dbe-b9c8-cc94429c6470 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:02.470119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2504-a453-4dbe-b9c8-cc94429c6470 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:02.470119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2504-a453-4dbe-b9c8-cc94429c6470 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:02.471508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 572/1162] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:02:02.477029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b0b7-437f-4b2f-870a-a5be2c43ae3a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:02.477429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b0b7-437f-4b2f-870a-a5be2c43ae3a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:02.477568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b0b7-437f-4b2f-870a-a5be2c43ae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:02.541996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fbb0b0b7-437f-4b2f-870a-a5be2c43ae3a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:02:02.543128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fbb0b0b7-437f-4b2f-870a-a5be2c43ae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:02.637839 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 591/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:02:02.926886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2504-a453-4dbe-b9c8-cc94429c6470 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:02:02.928460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ec2f2504-a453-4dbe-b9c8-cc94429c6470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:03.030080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2504-a453-4dbe-b9c8-cc94429c6470 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:02:03.100043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:03.101737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:02:03.102421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:03.102667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:03.102945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:03.104584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:03.215465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:02:03.217484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1ca8a-7e33-4218-a80f-226dfe820ad0 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:02:03.235599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 573/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:02:05.529172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a2b90-cc50-47c3-bbe3-f473cff1fb48 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:05.529733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a2b90-cc50-47c3-bbe3-f473cff1fb48 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:05.529733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a2b90-cc50-47c3-bbe3-f473cff1fb48 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:05.531056 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 592/1165] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:02:05.536489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6fb0b-207f-4c75-bf38-b4f61fcea1ef None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:05.536915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6fb0b-207f-4c75-bf38-b4f61fcea1ef None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:05.537073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6fb0b-207f-4c75-bf38-b4f61fcea1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:05.602593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0aa6fb0b-207f-4c75-bf38-b4f61fcea1ef None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:02:05.603795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0aa6fb0b-207f-4c75-bf38-b4f61fcea1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:05.656778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:05.701041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 574/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:02:05.992981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a2b90-cc50-47c3-bbe3-f473cff1fb48 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:02:05.994521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b95a2b90-cc50-47c3-bbe3-f473cff1fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:06.030419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:06.098305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a2b90-cc50-47c3-bbe3-f473cff1fb48 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:02:06.175618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:02:06.176225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:06.176547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:06.176821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:06.178464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:06.258157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:06.287266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:02:06.288743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4be7b-ec86-4e1d-b7ce-03c2c991ee56 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:02:06.307466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 593/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:02:08.909725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6204-5a5d-46d5-8f7b-7349aa690960 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:08.910293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6204-5a5d-46d5-8f7b-7349aa690960 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:08.910293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6204-5a5d-46d5-8f7b-7349aa690960 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:08.911604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 575/1168] 10.222.0.13 () {54 vars in 927 bytes} [Fri Oct 14 03:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:02:08.916951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee92c2f-e94b-4077-a7b1-7e107bad312b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:08.917378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee92c2f-e94b-4077-a7b1-7e107bad312b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:08.917646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee92c2f-e94b-4077-a7b1-7e107bad312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:08.984029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8ee92c2f-e94b-4077-a7b1-7e107bad312b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:02:08.985196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8ee92c2f-e94b-4077-a7b1-7e107bad312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:09.082378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 594/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Fri Oct 14 03:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:02:09.370699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb6204-5a5d-46d5-8f7b-7349aa690960 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:02:09.372805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b0eb6204-5a5d-46d5-8f7b-7349aa690960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:09.472760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb6204-5a5d-46d5-8f7b-7349aa690960 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:02:09.544022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:02:09.544643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:02:09.544921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:02:09.545186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:02:09.546759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:02:09.555066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:09.656188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:02:09.657636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5d135-e877-43b0-89bf-f22f03bb0359 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:02:09.676105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 576/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:02:19.080878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=82 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:02:19.674181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=50 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:03:59.190906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.199180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.199180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.271825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:03:59.273043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:03:59.373858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 595/1171] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:03:59.381809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.382282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.382382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.401774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:03:59.402947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:03:59.411867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 577/1172] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:03:59.416114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:03:59.425518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7916eb-1fd1-4772-b948-4423d29a3916 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:03:59.430702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:03:59.431302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.431580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.431852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.432529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:03:59.432833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:03:59.433841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:03:59.433841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 03:03:59.433841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 03:03:59.434726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:03:59.445917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 596/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:03:59.454731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:03:59.463828 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad1100-dee3-451e-b14f-3c344b5ae038 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:03:59.468483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:03:59.469080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.469356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.469626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.470256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:03:59.471576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:03:59.471576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 03:03:59.471576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 03:03:59.472793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:03:59.561674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 578/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:03:59 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:03:59.565780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:03:59.576297 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec84d9-a1de-441f-8a4e-261a40ba2793 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:03:59.624914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:03:59.632194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 03:03:59.635790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 03:03:59.636482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:03:59.732523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 597/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:03:59 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:03:59.736507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:03:59.747537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ea78-5af1-4a97-96fa-4036dec45fe3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:03:59.752146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:03:59.752785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.753068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.753342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.753986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:03:59.756190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:03:59.768848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 579/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:03:59.772864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:03:59.782655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e8586-4644-4f99-bcef-a7d093377aeb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:03:59.787258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81308105-65d6-47b2-8d94-6ac48dc4b756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:03:59.787857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81308105-65d6-47b2-8d94-6ac48dc4b756 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.788138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81308105-65d6-47b2-8d94-6ac48dc4b756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.788447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81308105-65d6-47b2-8d94-6ac48dc4b756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.789096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81308105-65d6-47b2-8d94-6ac48dc4b756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:03:59.790700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81308105-65d6-47b2-8d94-6ac48dc4b756 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:03:59.805392 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 598/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:03:59.809336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:03:59.819874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022ca59-28f5-41af-8c39-9e2e02d7374e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:03:59.824518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075579a8-12e7-47a4-8edd-45a05836ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:03:59.825158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075579a8-12e7-47a4-8edd-45a05836ddb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.825436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075579a8-12e7-47a4-8edd-45a05836ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.825708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075579a8-12e7-47a4-8edd-45a05836ddb1 admin admin] PATH_INFO: `/v3/projects/30f62bbf377f4ebd92470e71224d6af5/users/4a2ea659fe6047909d85da08f13992c0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.841040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075579a8-12e7-47a4-8edd-45a05836ddb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f62bbf377f4ebd92470e71224d6af5, user_id=4a2ea659fe6047909d85da08f13992c0, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:03:59.843747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075579a8-12e7-47a4-8edd-45a05836ddb1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:03:59.915167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 580/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:03:59 2022] PUT /identity/v3/projects/30f62bbf377f4ebd92470e71224d6af5/users/4a2ea659fe6047909d85da08f13992c0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:03:59.931614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c040f-4209-4e62-aeb1-c20aedd02786 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:03:59.931906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c040f-4209-4e62-aeb1-c20aedd02786 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:03:59.932188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c040f-4209-4e62-aeb1-c20aedd02786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:03:59.959573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ff8c040f-4209-4e62-aeb1-c20aedd02786 None None] MFA Rules not processed for user `4a2ea659fe6047909d85da08f13992c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:03:59.960810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ff8c040f-4209-4e62-aeb1-c20aedd02786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:04:00.022611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 599/1179] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:03:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:04:00.035550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9dd36-5606-48ae-a0a1-4eb3e6989179 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.036370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9dd36-5606-48ae-a0a1-4eb3e6989179 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.036673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9dd36-5606-48ae-a0a1-4eb3e6989179 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.038060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 581/1180] 10.222.0.13 () {54 vars in 963 bytes} [Fri Oct 14 03:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:04:00.043138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2a5d3-77f5-4de9-844d-100fbd937986 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.043428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2a5d3-77f5-4de9-844d-100fbd937986 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.043706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2a5d3-77f5-4de9-844d-100fbd937986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.101664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0ce2a5d3-77f5-4de9-844d-100fbd937986 None None] MFA Rules not processed for user `531145399f98493daef67bc1aa803a93`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:04:00.102862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0ce2a5d3-77f5-4de9-844d-100fbd937986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:04:00.177182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 600/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Fri Oct 14 03:04:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:04:00.185097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9dd36-5606-48ae-a0a1-4eb3e6989179 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:04:00.195513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9dd36-5606-48ae-a0a1-4eb3e6989179 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:04:00.199017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:04:00.199603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.199884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.200155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.208072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:04:00.209535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:04:00.218141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 582/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:04:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:04:00.263124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b5b9-e8f5-43bb-8ac9-081f00ca12c9 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.263558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b5b9-e8f5-43bb-8ac9-081f00ca12c9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.263826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82b5b9-e8f5-43bb-8ac9-081f00ca12c9 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.265112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 601/1183] 10.222.0.13 () {52 vars in 830 bytes} [Fri Oct 14 03:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:04:00.268667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:04:00.329431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aab4b9-104f-462c-92b2-c600be47fce2 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:04:00.334539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:04:00.335140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.335420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.335694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] PATH_INFO: `/v3/users/4a2ea659fe6047909d85da08f13992c0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.336841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2ea659fe6047909d85da08f13992c0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:04:00.337853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:04:00.337853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 03:04:00.337853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 03:04:00.339034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:04:00.529860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2ea659fe6047909d85da08f13992c0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:00.544796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2ea659fe6047909d85da08f13992c0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:00.546284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2ea659fe6047909d85da08f13992c0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:00.612470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2ea659fe6047909d85da08f13992c0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:00.634966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:04:00.637597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2ea659fe6047909d85da08f13992c0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:00.643638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 583/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:04:00 2022] DELETE /identity/v3/users/4a2ea659fe6047909d85da08f13992c0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:04:00.648740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.649031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.649325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.668043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:04:00.670206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:04:00.678446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:04:00.727926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 602/1185] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:04:00.737679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:04:00.739142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:04:00.814960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b75c7-11b9-4dce-8e98-2ab822f3d228 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:04:00.819150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f6be2-2ba4-4dca-8d42-82a5484bebec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:04:00.819761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6be2-2ba4-4dca-8d42-82a5484bebec service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:00.820041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6be2-2ba4-4dca-8d42-82a5484bebec service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:00.820314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6be2-2ba4-4dca-8d42-82a5484bebec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:00.829087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f6be2-2ba4-4dca-8d42-82a5484bebec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:04:00.830518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f6be2-2ba4-4dca-8d42-82a5484bebec service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:04:00.840434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 584/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:04:01.259806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:04:01.261330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:04:01.272926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2b6e0-1bef-459a-a531-2e716b0fc46b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:04:01.277622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:04:01.280744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:04:01.280744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:04:01.280744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] PATH_INFO: `/v3/projects/30f62bbf377f4ebd92470e71224d6af5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:04:01.280744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f62bbf377f4ebd92470e71224d6af5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:04:01.281061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:04:01.281061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 03:04:01.281061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 03:04:01.282103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:04:01.376168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f62bbf377f4ebd92470e71224d6af5', 'request_id': 'req-dbb87fda-918d-4327-98a0-3a39db5aac49'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:01.390384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f62bbf377f4ebd92470e71224d6af5', 'request_id': 'req-dbb87fda-918d-4327-98a0-3a39db5aac49'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:01.452047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f62bbf377f4ebd92470e71224d6af5', 'request_id': 'req-dbb87fda-918d-4327-98a0-3a39db5aac49'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:01.463235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] The token cache is being invalidate because project 30f62bbf377f4ebd92470e71224d6af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:04:01.463523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:01.464240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbb87fda-918d-4327-98a0-3a39db5aac49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:04:01.465832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 603/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:04:01 2022] DELETE /identity/v3/projects/30f62bbf377f4ebd92470e71224d6af5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:04:10.869413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:04:11.460145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:33.260111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b42f5-e249-4fdd-a7af-f5f70ecee3c0 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:33.260743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b42f5-e249-4fdd-a7af-f5f70ecee3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:33.260743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b42f5-e249-4fdd-a7af-f5f70ecee3c0 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:33.262092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 585/1188] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:33.267534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094cfb2-26f0-47b0-bf16-840e499442ee None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:33.273720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094cfb2-26f0-47b0-bf16-840e499442ee None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:33.273720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094cfb2-26f0-47b0-bf16-840e499442ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:33.288273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6094cfb2-26f0-47b0-bf16-840e499442ee None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:33.289501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6094cfb2-26f0-47b0-bf16-840e499442ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:33.349554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 604/1189] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:05:33.502517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b42f5-e249-4fdd-a7af-f5f70ecee3c0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:33.508307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-761b42f5-e249-4fdd-a7af-f5f70ecee3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:33.604628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b42f5-e249-4fdd-a7af-f5f70ecee3c0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:33.610124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af921a-db8a-4a8d-b6c9-83c7dadc7e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:33.610753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af921a-db8a-4a8d-b6c9-83c7dadc7e5f service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:33.611041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af921a-db8a-4a8d-b6c9-83c7dadc7e5f service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:33.611319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af921a-db8a-4a8d-b6c9-83c7dadc7e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:33.619203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af921a-db8a-4a8d-b6c9-83c7dadc7e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:33.620832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af921a-db8a-4a8d-b6c9-83c7dadc7e5f service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:33.630465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 586/1190] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:05:34.707656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c27c-5fb7-45e3-b569-c571a2a197c7 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:34.708181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c27c-5fb7-45e3-b569-c571a2a197c7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:34.708278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c27c-5fb7-45e3-b569-c571a2a197c7 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:34.709605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 605/1191] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:34.716143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4d04-8434-4d34-a882-8ad7dd8c9fc6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:34.716584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4d04-8434-4d34-a882-8ad7dd8c9fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:34.716740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef4d04-8434-4d34-a882-8ad7dd8c9fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:34.736242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-58ef4d04-8434-4d34-a882-8ad7dd8c9fc6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:34.737453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-58ef4d04-8434-4d34-a882-8ad7dd8c9fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:34.745140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 587/1192] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:34.879847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4114b5-ac9b-40cd-b22b-fccc519548e5 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:34.880142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4114b5-ac9b-40cd-b22b-fccc519548e5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:34.880446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4114b5-ac9b-40cd-b22b-fccc519548e5 None None] PATH_INFO: `/v3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:34.881881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 606/1193] 10.222.0.44 () {54 vars in 925 bytes} [Fri Oct 14 03:05:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:05:34.888066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff462d-8713-4235-95fe-32f8ff6cbe95 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:34.888354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff462d-8713-4235-95fe-32f8ff6cbe95 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:34.888663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff462d-8713-4235-95fe-32f8ff6cbe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:34.899999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4114b5-ac9b-40cd-b22b-fccc519548e5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:34.914422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4114b5-ac9b-40cd-b22b-fccc519548e5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:34.920373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ff302-c2d0-45a9-b4e3-59ea0df0e77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:34.920995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff302-c2d0-45a9-b4e3-59ea0df0e77e service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:34.921276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff302-c2d0-45a9-b4e3-59ea0df0e77e service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:34.921552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff302-c2d0-45a9-b4e3-59ea0df0e77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:34.929688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ff302-c2d0-45a9-b4e3-59ea0df0e77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:34.931235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ff302-c2d0-45a9-b4e3-59ea0df0e77e service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:34.941183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c5ff462d-8713-4235-95fe-32f8ff6cbe95 None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:34.941621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 607/1194] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:05:34.942391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c5ff462d-8713-4235-95fe-32f8ff6cbe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:35.019287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 588/1195] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Oct 14 03:05:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:05:43.750531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd744e3f-051b-4fef-aeb9-7d56d4fe56d1 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:43.751006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd744e3f-051b-4fef-aeb9-7d56d4fe56d1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:43.751104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd744e3f-051b-4fef-aeb9-7d56d4fe56d1 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:43.752442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 608/1196] 10.222.0.13 () {54 vars in 961 bytes} [Fri Oct 14 03:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:43.757551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c5fe-10f3-4008-a4b7-f121ce9fc835 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:43.757979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c5fe-10f3-4008-a4b7-f121ce9fc835 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:43.758194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c5fe-10f3-4008-a4b7-f121ce9fc835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:43.777194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2fc5c5fe-10f3-4008-a4b7-f121ce9fc835 None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:43.778408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2fc5c5fe-10f3-4008-a4b7-f121ce9fc835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:43.786894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 589/1197] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Oct 14 03:05:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:43.794285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd744e3f-051b-4fef-aeb9-7d56d4fe56d1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:43.807768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd744e3f-051b-4fef-aeb9-7d56d4fe56d1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:43.813327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51707e43-1711-48ba-9f87-31e107c777aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:43.813977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707e43-1711-48ba-9f87-31e107c777aa service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:43.814284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707e43-1711-48ba-9f87-31e107c777aa service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:43.814555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51707e43-1711-48ba-9f87-31e107c777aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:43.822755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51707e43-1711-48ba-9f87-31e107c777aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:43.824333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51707e43-1711-48ba-9f87-31e107c777aa service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:43.833717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 609/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:05:46.390768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7b2a-f5e0-4b08-8b15-9f64b7d8cc42 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:46.391217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7b2a-f5e0-4b08-8b15-9f64b7d8cc42 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:46.391323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c7b2a-f5e0-4b08-8b15-9f64b7d8cc42 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:46.392675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 590/1199] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:46.398811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97248-ee23-4f3f-bbc4-1ae7683d4b0d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:46.399240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97248-ee23-4f3f-bbc4-1ae7683d4b0d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:46.399390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f97248-ee23-4f3f-bbc4-1ae7683d4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:46.419147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f8f97248-ee23-4f3f-bbc4-1ae7683d4b0d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:46.421147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f8f97248-ee23-4f3f-bbc4-1ae7683d4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:46.428926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 610/1200] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:46.580329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c7b2a-f5e0-4b08-8b15-9f64b7d8cc42 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:46.595138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c7b2a-f5e0-4b08-8b15-9f64b7d8cc42 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:46.600505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461549d-9e5a-438b-b2d3-64c26ddb16d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:46.601728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461549d-9e5a-438b-b2d3-64c26ddb16d9 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:46.601728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461549d-9e5a-438b-b2d3-64c26ddb16d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:46.601728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461549d-9e5a-438b-b2d3-64c26ddb16d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:46.608072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:05:46.610312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461549d-9e5a-438b-b2d3-64c26ddb16d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:46.611931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461549d-9e5a-438b-b2d3-64c26ddb16d9 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:46.621185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 591/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:05:47.692328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433918ed-fbc7-476b-8007-afc4edd30a4f None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:47.692879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433918ed-fbc7-476b-8007-afc4edd30a4f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:47.692975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433918ed-fbc7-476b-8007-afc4edd30a4f None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:47.694326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 611/1202] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 14 03:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:47.700785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60590477-5c04-4eef-8f9c-129f04bf361f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:47.701279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60590477-5c04-4eef-8f9c-129f04bf361f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:47.701395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60590477-5c04-4eef-8f9c-129f04bf361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:47.720869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-60590477-5c04-4eef-8f9c-129f04bf361f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:47.722081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-60590477-5c04-4eef-8f9c-129f04bf361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:47.729894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 592/1203] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 14 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:47.882689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433918ed-fbc7-476b-8007-afc4edd30a4f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:47.896976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433918ed-fbc7-476b-8007-afc4edd30a4f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:47.902229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5d5e-8c66-4e43-8d54-2f44c4c5be74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:47.902821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5d5e-8c66-4e43-8d54-2f44c4c5be74 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:47.903101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5d5e-8c66-4e43-8d54-2f44c4c5be74 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:47.903374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5d5e-8c66-4e43-8d54-2f44c4c5be74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:47.911729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5d5e-8c66-4e43-8d54-2f44c4c5be74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:47.913323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5d5e-8c66-4e43-8d54-2f44c4c5be74 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:47.923076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 612/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:05:51.860038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c7ae-701a-4e8f-bd3d-4b491039bcb1 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:51.860612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c7ae-701a-4e8f-bd3d-4b491039bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:51.860704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892c7ae-701a-4e8f-bd3d-4b491039bcb1 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:51.862045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 593/1205] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:51.867364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3af93-f6e6-48b5-8dde-7c4bde4b2d34 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:51.867789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3af93-f6e6-48b5-8dde-7c4bde4b2d34 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:51.867916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3af93-f6e6-48b5-8dde-7c4bde4b2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:51.886873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-43f3af93-f6e6-48b5-8dde-7c4bde4b2d34 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:51.888108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-43f3af93-f6e6-48b5-8dde-7c4bde4b2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:51.895850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 613/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:52.188061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c7ae-701a-4e8f-bd3d-4b491039bcb1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:52.189775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a892c7ae-701a-4e8f-bd3d-4b491039bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:52.246309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892c7ae-701a-4e8f-bd3d-4b491039bcb1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:52.249957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6741f-5a4a-4253-9548-ec3da93fe9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:52.250556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6741f-5a4a-4253-9548-ec3da93fe9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:52.250837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6741f-5a4a-4253-9548-ec3da93fe9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:52.251105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6741f-5a4a-4253-9548-ec3da93fe9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:52.259888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6741f-5a4a-4253-9548-ec3da93fe9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:52.261344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6741f-5a4a-4253-9548-ec3da93fe9a7 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:52.270949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 594/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:05:54.402137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a89ab-60f9-4839-ab71-d3df9c70150c None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:54.402626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a89ab-60f9-4839-ab71-d3df9c70150c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:54.402720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a89ab-60f9-4839-ab71-d3df9c70150c None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:54.404045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 614/1208] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:54.409295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78d2ec-b01b-4024-958b-dc03ce9423f3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:54.409696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78d2ec-b01b-4024-958b-dc03ce9423f3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:54.409856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78d2ec-b01b-4024-958b-dc03ce9423f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:54.429466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ca78d2ec-b01b-4024-958b-dc03ce9423f3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:54.431005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ca78d2ec-b01b-4024-958b-dc03ce9423f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:54.438923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 595/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:54.723208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a89ab-60f9-4839-ab71-d3df9c70150c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:54.734619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a89ab-60f9-4839-ab71-d3df9c70150c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:54.738174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cda0-9046-49c1-bc69-50aad41ffc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:54.738785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cda0-9046-49c1-bc69-50aad41ffc4f service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:54.739043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cda0-9046-49c1-bc69-50aad41ffc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:54.739321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cda0-9046-49c1-bc69-50aad41ffc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:54.747927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700cda0-9046-49c1-bc69-50aad41ffc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:54.749390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700cda0-9046-49c1-bc69-50aad41ffc4f service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:54.758549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 615/1210] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:05:58.339380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72152e0-d72c-4e4a-9721-2dcf537ff6da None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:58.340236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72152e0-d72c-4e4a-9721-2dcf537ff6da None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:58.340236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72152e0-d72c-4e4a-9721-2dcf537ff6da None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:58.341868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 596/1211] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:05:58.347109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531dfe-cb5e-477e-af26-b532d1c25946 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:58.347569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531dfe-cb5e-477e-af26-b532d1c25946 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:58.347683 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70531dfe-cb5e-477e-af26-b532d1c25946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:58.366872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-70531dfe-cb5e-477e-af26-b532d1c25946 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:05:58.368680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-70531dfe-cb5e-477e-af26-b532d1c25946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:58.376616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 616/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:05:58.682817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72152e0-d72c-4e4a-9721-2dcf537ff6da None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:05:58.685162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a72152e0-d72c-4e4a-9721-2dcf537ff6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:05:58.740742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72152e0-d72c-4e4a-9721-2dcf537ff6da None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:05:58.744206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62387ea9-9329-474e-af1b-3edfa6125f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:05:58.744833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387ea9-9329-474e-af1b-3edfa6125f45 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:05:58.745114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387ea9-9329-474e-af1b-3edfa6125f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:05:58.745386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62387ea9-9329-474e-af1b-3edfa6125f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:05:58.755882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387ea9-9329-474e-af1b-3edfa6125f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:05:58.757380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62387ea9-9329-474e-af1b-3edfa6125f45 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:05:58.766846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 597/1213] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:05:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:06:00.866522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac699085-2a34-4a26-97f9-8ee8f7bb2e64 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:06:00.867086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac699085-2a34-4a26-97f9-8ee8f7bb2e64 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:06:00.867086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac699085-2a34-4a26-97f9-8ee8f7bb2e64 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:06:00.868414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 617/1214] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 14 03:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:06:00.873659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440fba-49bc-40b5-82dc-ee68ac691ee0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:06:00.874138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440fba-49bc-40b5-82dc-ee68ac691ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:06:00.874244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00440fba-49bc-40b5-82dc-ee68ac691ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:06:00.893077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-00440fba-49bc-40b5-82dc-ee68ac691ee0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:06:00.894257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-00440fba-49bc-40b5-82dc-ee68ac691ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:06:00.901915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 598/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 14 03:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:06:01.198549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac699085-2a34-4a26-97f9-8ee8f7bb2e64 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:06:01.200926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ac699085-2a34-4a26-97f9-8ee8f7bb2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:06:01.213576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac699085-2a34-4a26-97f9-8ee8f7bb2e64 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:06:01.217895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ed7e5-f877-4c1e-87aa-3ba1ae02204f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:06:01.218481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed7e5-f877-4c1e-87aa-3ba1ae02204f service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:06:01.218756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed7e5-f877-4c1e-87aa-3ba1ae02204f service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:06:01.219024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed7e5-f877-4c1e-87aa-3ba1ae02204f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:06:01.227631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ed7e5-f877-4c1e-87aa-3ba1ae02204f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:06:01.229077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ed7e5-f877-4c1e-87aa-3ba1ae02204f service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:06:01.238131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 618/1216] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:06:10.888373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=63 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:06:11.234089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=66 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:26.734284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2af95f-34c7-4a4e-a80e-bb330f8bf241 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.734946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2af95f-34c7-4a4e-a80e-bb330f8bf241 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.734946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2af95f-34c7-4a4e-a80e-bb330f8bf241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.760725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ae2af95f-34c7-4a4e-a80e-bb330f8bf241 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:26.761927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ae2af95f-34c7-4a4e-a80e-bb330f8bf241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:26.771489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 599/1217] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:07:26.772957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8da0-6adb-4cd5-b411-839849136490 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.773514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8da0-6adb-4cd5-b411-839849136490 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.773514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd8da0-6adb-4cd5-b411-839849136490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.785035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.785571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.786018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.817450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:26.818231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6bdd8da0-6adb-4cd5-b411-839849136490 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:26.819161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:26.820215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6bdd8da0-6adb-4cd5-b411-839849136490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:26.832508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 600/1218] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:07:26.834608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 619/1219] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:07:26.849038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:26.849679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.849968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.850360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.864227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122482bc-369a-408a-a0ae-a1e2d3a878c9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:26.879798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:26.880730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.881184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.881623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.882471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:26.882942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:26.884182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:07:26.884182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 03:07:26.884182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 03:07:26.885409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:26.885542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:26.886742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:26.904376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 601/1220] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:26.908417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 620/1221] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:07:26.917098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:26.918471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:26.929179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eb196-a67c-4bd0-a25b-d72d2c430920 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:26.931873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3cef0-eff9-4640-b5f7-2e202d416194 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:26.946951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:26.947206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:26.947858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.948139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.948438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.948799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:26.949102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:26.949520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:26.950025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:26.950222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:07:26.950222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 03:07:26.950222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 03:07:26.951454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:26.951639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ab7c-87c4-411f-a5c4-eb11acb90109 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:26.952153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:26.953995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:26.973088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 602/1222] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:26.990555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.006678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64f8b-6ee7-4df9-a6bb-ba613834f766 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.018491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.019485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.019964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.020461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.021346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.024652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.089465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 621/1223] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:26 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:27.090838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.091075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.091357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.127495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.128949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.146984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 603/1224] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:26 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:07:27.149882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.217319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 622/1225] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.218293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.236483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b0d65-ecf0-45fb-8862-521bb2e4ff9b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.263900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61eba-0025-4907-84d5-435c102894d8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.280066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.281057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.281535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.281988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.282818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.284028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:07:27.284028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 03:07:27.284028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 03:07:27.285681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fd52d-5822-4d81-bf59-89d80f6499c4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.316137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.316789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.317120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.317395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.318036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.320415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.380271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 604/1226] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:27.381765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9664ed6-5c81-4f97-a759-b47aa9b437d7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.382054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9664ed6-5c81-4f97-a759-b47aa9b437d7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.382330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9664ed6-5c81-4f97-a759-b47aa9b437d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.402907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c9664ed6-5c81-4f97-a759-b47aa9b437d7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.404136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c9664ed6-5c81-4f97-a759-b47aa9b437d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.416627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 605/1227] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.416627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ba672-42b6-4f88-9d11-5ebbaac5139a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.416627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ba672-42b6-4f88-9d11-5ebbaac5139a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.416627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ba672-42b6-4f88-9d11-5ebbaac5139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.436919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ed1ba672-42b6-4f88-9d11-5ebbaac5139a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.441727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ed1ba672-42b6-4f88-9d11-5ebbaac5139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.446347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 606/1228] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.447587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5676d5-979f-4296-a969-55b6fdaae231 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.447879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5676d5-979f-4296-a969-55b6fdaae231 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.448153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5676d5-979f-4296-a969-55b6fdaae231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.467198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f5676d5-979f-4296-a969-55b6fdaae231 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.470361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f5676d5-979f-4296-a969-55b6fdaae231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.476952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 607/1229] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.478097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.478385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.478658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.496515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 623/1230] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:27.496515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.499356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.499453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.506323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a794beb-af5d-4b41-bc2e-816186a19e7b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.507748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 608/1231] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.508880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.511216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e52a9-c50f-4f3c-b736-e440a87c6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.511841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e52a9-c50f-4f3c-b736-e440a87c6be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.512115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e52a9-c50f-4f3c-b736-e440a87c6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.512381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e52a9-c50f-4f3c-b736-e440a87c6be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.513046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e52a9-c50f-4f3c-b736-e440a87c6be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.515380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e52a9-c50f-4f3c-b736-e440a87c6be4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.518960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546bb7d-8537-4854-87a8-00745db8936d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.524471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.525072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.525352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.525625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.526270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:27.526573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.526697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 624/1232] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:27.527846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae231efd-6b18-4643-9d1c-8425029df6a4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.528134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae231efd-6b18-4643-9d1c-8425029df6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.528244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74c388-15d1-4de8-a9bc-1416b5ab4822 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.528455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae231efd-6b18-4643-9d1c-8425029df6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.541217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 609/1233] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:27.542487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21129827-2e95-4cad-b7c6-dca9b015ee9e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.542777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21129827-2e95-4cad-b7c6-dca9b015ee9e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.543408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21129827-2e95-4cad-b7c6-dca9b015ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.548673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ae231efd-6b18-4643-9d1c-8425029df6a4 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.549985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ae231efd-6b18-4643-9d1c-8425029df6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.557883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 625/1234] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.559062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.559373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.559655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.563773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-21129827-2e95-4cad-b7c6-dca9b015ee9e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.565003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-21129827-2e95-4cad-b7c6-dca9b015ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.580791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 610/1235] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.580791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d14a2-1aab-42d9-b402-5515d3c90832 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.580791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d14a2-1aab-42d9-b402-5515d3c90832 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.580791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d14a2-1aab-42d9-b402-5515d3c90832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.581241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.581241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.588344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 626/1236] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.589170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.598403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bc458-c27b-4783-882b-8d94d3a6e150 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.599589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a54d14a2-1aab-42d9-b402-5515d3c90832 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.601450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a54d14a2-1aab-42d9-b402-5515d3c90832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.603503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.604103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.604380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.604680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.605320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.606911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.609541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 611/1237] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.610718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.611006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.611275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.619784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 627/1238] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:27.619784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.627910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495dbda-3285-4a1f-a2ce-4d75c1d09128 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.630601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.631758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.632526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380bf28-ff6b-45e9-8364-6f9d567e2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.633109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380bf28-ff6b-45e9-8364-6f9d567e2469 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.633391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380bf28-ff6b-45e9-8364-6f9d567e2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.633666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380bf28-ff6b-45e9-8364-6f9d567e2469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.634299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380bf28-ff6b-45e9-8364-6f9d567e2469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.635871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380bf28-ff6b-45e9-8364-6f9d567e2469 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.639675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 612/1239] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.640463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.649039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 628/1240] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:27.650116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb627b-9ea5-4232-afe1-3f31dccbbe3b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.650404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb627b-9ea5-4232-afe1-3f31dccbbe3b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.650778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb627b-9ea5-4232-afe1-3f31dccbbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.657148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9d248-168f-4586-8250-be56e3b709b5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.661743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.662348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.662656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.662927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.664208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.666172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.671853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-affb627b-9ea5-4232-afe1-3f31dccbbe3b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.673122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-affb627b-9ea5-4232-afe1-3f31dccbbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.681068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 629/1241] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.682253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.682535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.682810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.690457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:27.702269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:27.703446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:27.712082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 630/1242] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:27.712880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.724960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a88fe-2560-4649-be7c-92bef3dbdfaa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.727380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.727962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.728239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.728549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.729222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:27.729531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.731244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.742666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 631/1243] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:27.743428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.754650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 613/1244] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:27.754650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.759501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39602970-3d64-4691-a6a0-482d540c4888 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.763115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:27.811415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.812004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.812283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.812587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.813234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:27.813537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.815155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.816411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527105c4-2c0b-46b2-bc1f-b421045fa05a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.821175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.822202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.822202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.822420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.823033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.824643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.827206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 632/1245] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:27.828022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.836510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 614/1246] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:27.837534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.841840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273407c-24ff-43d2-9357-104c81a20999 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.846649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.854605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.854720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390c6ba-5639-48e8-8978-3f3795c65737 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.854832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.854832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.854832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:27.854832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.854832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.855241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.855241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.855241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.855241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] PATH_INFO: `/v3/projects/ab840c288db6497bbd3a4b221cddf009/users/2c196d842c4540b5800b4efa0ec4fc73/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.869156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab840c288db6497bbd3a4b221cddf009, user_id=2c196d842c4540b5800b4efa0ec4fc73, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.872311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.886760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 633/1247] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:27.887584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.897251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adcb62-7bb2-43d0-b7e9-64feabe4fb04 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.902459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.903061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.903336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.903606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.904241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:27.904573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.906128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.917231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 634/1248] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:27.918139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.927569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee530b2-623e-4e85-af6f-f656b8445d18 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:27.932287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:27.932888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:27.933173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:27.933451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:27.934078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:27.934497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:27.936061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:27.938227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 615/1249] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:27 2022] PUT /identity/v3/projects/ab840c288db6497bbd3a4b221cddf009/users/2c196d842c4540b5800b4efa0ec4fc73/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:27.939101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.956078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 635/1250] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:27.956078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:27.959467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3f175-1856-4773-ab8b-ccfc3786a83e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.009507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b45c5-21b7-4e32-a242-2f4461c7c1d0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.014139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.014743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.015025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.015302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.015938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.017892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.019296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.019970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.020318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.020684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.021306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.023843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.127617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 616/1251] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.128449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.166158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 636/1252] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:27 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.167406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.176972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca6c7-ff6d-4a3a-81d0-9575e51a27e8 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.189644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8894fcc-87c4-4856-a43e-3347e9094fba admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.195132 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.195736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.196018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.196289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.196967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.198889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.202276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:28.208596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:28.234837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.235529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.235807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.236079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] PATH_INFO: `/v3/projects/8b6e8512548449958d68927e75882932/users/ffc19ded49a74261b48bbe7c2a7f1904/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.249435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6e8512548449958d68927e75882932, user_id=ffc19ded49a74261b48bbe7c2a7f1904, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.252117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.287563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 617/1253] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.288376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.343280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 637/1254] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:28 2022] PUT /identity/v3/projects/8b6e8512548449958d68927e75882932/users/ffc19ded49a74261b48bbe7c2a7f1904/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:28.344238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.350523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ea1d6-6805-4c2c-9eab-dbdb2a3eba4b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.406698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6f21-67bb-4a97-876f-9975067f0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.407302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6f21-67bb-4a97-876f-9975067f0f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.407580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6f21-67bb-4a97-876f-9975067f0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.407696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46040f-70b0-445e-aab5-1f2e0549d338 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.407852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6f21-67bb-4a97-876f-9975067f0f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.408513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee6f21-67bb-4a97-876f-9975067f0f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.410434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee6f21-67bb-4a97-876f-9975067f0f6c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.412333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.412977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.413242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.413516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.414141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.416045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.493318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 618/1255] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.494719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.495014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.495292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.513963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:28.515159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:28.540125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 638/1256] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.540125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.575782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 619/1257] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:28.576630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.586143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865075a3-acf5-4f30-b007-6f74971c340d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.600363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7832096-4637-4982-8090-6df3bda5e944 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.604002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:28.605580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.606224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.606505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.606778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.607410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.609458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.644094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.644737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.645023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.645298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.645930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.647930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.731253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 639/1258] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.732164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.752758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:28.760309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 620/1259] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.760309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.769353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624b28b-1b8f-4230-9492-3c57e73fb11b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.797552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfefbd3-f16c-4cd5-b57a-141dd169f971 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.802096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352eec4-1201-41ab-b48d-6e3e7c4808cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.802701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352eec4-1201-41ab-b48d-6e3e7c4808cf admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.802981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352eec4-1201-41ab-b48d-6e3e7c4808cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.804493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352eec4-1201-41ab-b48d-6e3e7c4808cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.804609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352eec4-1201-41ab-b48d-6e3e7c4808cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.806176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352eec4-1201-41ab-b48d-6e3e7c4808cf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.818605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 640/1260] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:28.818605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.818605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.818605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.831421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.832040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.832359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.832634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.833271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.835493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.837939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:28.839140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:28.846952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 641/1261] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:28.847808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.857717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a6cce-c7af-4c23-955b-ff5cfb7bc2bd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.862535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.872892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.872892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.872892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.872892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.872892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.957809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 621/1262] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.957809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:28.965554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ece3eb-c617-43fe-ab75-0cd4269c73a9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:28.970158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:28.970733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:28.971019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:28.971296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:28.971907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:28.973888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:28.983287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 642/1263] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:28.984228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.039416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa3593-d6dc-404c-aee4-be92f3ea390b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.043060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.043658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.043940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.044213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.053185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.054611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.063857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 643/1264] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:29.064743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.074561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 622/1265] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:28 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:29.074561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.077903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe326f-679d-4f2f-aa9b-111773703efd service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.083211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.083540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984f492-e858-4dc5-9066-88d0bb9af1ba admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.083824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.084107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.084382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.085940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.087861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.089304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.089910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.093158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.093158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.093158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.093158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.104731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 623/1266] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.105616 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.115172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d3719-7d4c-47a7-9c13-d80930b8a434 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.119786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.121561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.121561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.121561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.121849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.123135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.132827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 624/1267] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.133610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.142597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfac28-9d14-4779-b699-26fd71455774 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.146165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.150250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.150250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.150250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.156474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.157858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.167552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 625/1268] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:29.168296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.177013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0db05-762c-4266-a706-5923cd94f1d0 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.181553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.182137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.182425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.182697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.183370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.185040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.190146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 644/1269] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:29 2022] POST /identity/v3/users => generated 283 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:29.190146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.198237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 626/1270] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.198400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b2cf6-a0f6-419f-9171-3fd3d31eacad admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.199074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.204280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.205086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.205430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.205774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.206487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.208178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.212156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118d8a-f237-49b0-81fd-cdec4bcf1df3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.217417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.218046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.218657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.218657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.219210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.220838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.225063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 645/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.225063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.234483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e25ad-8a7a-423b-9822-6b7e52c5d62f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.236656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 627/1272] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.236656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.239727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.240251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.240863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.240992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.241695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.243358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.251066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c73b2a-4962-4495-bb05-758fd2cbc56d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.253750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 646/1273] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.257004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.259205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.259990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.260379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.260742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] PATH_INFO: `/v3/projects/b28c1645ea1f4941ab2d016ad313ae6b/users/1201fb5f14154b048f5c55bd566e91b9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.264839 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003dd59-7c63-45b3-9438-138c7dff462e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.270083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.270766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.271046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.271319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.271966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.274136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.279036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28c1645ea1f4941ab2d016ad313ae6b, user_id=1201fb5f14154b048f5c55bd566e91b9, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.281887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.284819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 647/1274] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.285641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.295557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba512b85-7d93-4e53-b0fe-495f3c008a39 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.300073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.300668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.300949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.301222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.301853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.303504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.313806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 648/1275] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.314455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.323995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86005b67-1d40-4eac-8388-6108e608895d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.328690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.329275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.329554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.329830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.330463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.332038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.342636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 649/1276] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.343507 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.356608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d3fd1-39d8-4a47-ac32-ec538df04419 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.361792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.362338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.362621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.362897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.363537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.365159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.380179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 650/1277] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.380849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.389290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 628/1278] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:29 2022] PUT /identity/v3/projects/b28c1645ea1f4941ab2d016ad313ae6b/users/1201fb5f14154b048f5c55bd566e91b9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:29.390395 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.391394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed353-a8dd-4cb0-b1d7-95c57638cb2b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.395403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:29.400670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:29.456461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aacd5-f9f7-4a5e-a98c-ac5ff0741f33 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.458294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.459181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.459467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.459794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] PATH_INFO: `/v3/projects/7023e0d1a56346108b270216bb5dc577/users/b2b2b170e1ca4bb58e6547e728a7075d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.462299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.462967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.463250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.463537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.464170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.465829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.476031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 629/1279] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:29.477069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.481548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7023e0d1a56346108b270216bb5dc577, user_id=b2b2b170e1ca4bb58e6547e728a7075d, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.484560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.492541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31dc877-aa81-4a82-b466-28b38f4e5a3d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.499351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.500149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.500459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.500739 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] PATH_INFO: `/v3/projects/480aef72b62f45e09f59cfa48ba9a854/users/4553b7573ca34af6a9fdb94f80717f24/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.517487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480aef72b62f45e09f59cfa48ba9a854, user_id=4553b7573ca34af6a9fdb94f80717f24, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.520141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.570004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 651/1280] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:29 2022] PUT /identity/v3/projects/7023e0d1a56346108b270216bb5dc577/users/b2b2b170e1ca4bb58e6547e728a7075d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:29.571989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.627784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 630/1281] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:29 2022] PUT /identity/v3/projects/480aef72b62f45e09f59cfa48ba9a854/users/4553b7573ca34af6a9fdb94f80717f24/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:29.629891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.641524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b78cf6-a657-47c0-9539-4de3a3de5b85 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.711040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ae6e2-aed9-4461-bb6c-d65a2e996633 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.715910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8a04b-9165-4218-a7e3-0ec7699d785a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.716608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a04b-9165-4218-a7e3-0ec7699d785a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.716892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a04b-9165-4218-a7e3-0ec7699d785a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.717171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8a04b-9165-4218-a7e3-0ec7699d785a admin admin] PATH_INFO: `/v3/projects/2a03d2fd7e4e49e9a521cf2cc6a65e99/users/94dd17b06cc140f7a48e1fdee39ece6b/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.726348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.730638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.730638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.730638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] PATH_INFO: `/v3/projects/61f89b8e68d14d3d96fa84ab1697fcea/users/dbf0723a0f3942d2b9b2554320878016/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.733841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8a04b-9165-4218-a7e3-0ec7699d785a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a03d2fd7e4e49e9a521cf2cc6a65e99, user_id=94dd17b06cc140f7a48e1fdee39ece6b, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.736606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8a04b-9165-4218-a7e3-0ec7699d785a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.744954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f89b8e68d14d3d96fa84ab1697fcea, user_id=dbf0723a0f3942d2b9b2554320878016, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.747607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:29.813150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 631/1282] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:29 2022] PUT /identity/v3/projects/2a03d2fd7e4e49e9a521cf2cc6a65e99/users/94dd17b06cc140f7a48e1fdee39ece6b/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:29.813150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fadf-4c02-45f4-928a-2580da431ae3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.813150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fadf-4c02-45f4-928a-2580da431ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.813150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fadf-4c02-45f4-928a-2580da431ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.839002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d1c4fadf-4c02-45f4-928a-2580da431ae3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:29.840286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d1c4fadf-4c02-45f4-928a-2580da431ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:29.866508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 652/1283] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:29 2022] PUT /identity/v3/projects/61f89b8e68d14d3d96fa84ab1697fcea/users/dbf0723a0f3942d2b9b2554320878016/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:29.866508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:29.900068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:29.901248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:29.909369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 632/1284] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:29.918144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac9a0-11bd-4472-8c0c-5b3bd17f1345 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.918496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac9a0-11bd-4472-8c0c-5b3bd17f1345 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.919283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bac9a0-11bd-4472-8c0c-5b3bd17f1345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.951471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df17040-d379-4f52-9ce3-0c460c1526fd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:29.956357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a9306-5328-41b8-81e5-6222588c08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:29.956987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-38bac9a0-11bd-4472-8c0c-5b3bd17f1345 None None] MFA Rules not processed for user `b2b2b170e1ca4bb58e6547e728a7075d`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:29.957105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9306-5328-41b8-81e5-6222588c08c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:29.959782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9306-5328-41b8-81e5-6222588c08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:29.959782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a9306-5328-41b8-81e5-6222588c08c2 admin admin] PATH_INFO: `/v3/projects/f682372b91f14a878d08f5d3312efcef/users/187109ae45c74f19a26c320913a738b3/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:29.959991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-38bac9a0-11bd-4472-8c0c-5b3bd17f1345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:29.973406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a9306-5328-41b8-81e5-6222588c08c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f682372b91f14a878d08f5d3312efcef, user_id=187109ae45c74f19a26c320913a738b3, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:29.976178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a9306-5328-41b8-81e5-6222588c08c2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.030263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 633/1285] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:30.030263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8883a32-5fee-4740-bacc-0bfa39f0638e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.030263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8883a32-5fee-4740-bacc-0bfa39f0638e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.030263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8883a32-5fee-4740-bacc-0bfa39f0638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.046432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b8883a32-5fee-4740-bacc-0bfa39f0638e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:30.047631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b8883a32-5fee-4740-bacc-0bfa39f0638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.066205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 634/1286] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:30.066205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fc097-683b-486f-9cdc-915944edd630 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.066205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fc097-683b-486f-9cdc-915944edd630 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.066205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fc097-683b-486f-9cdc-915944edd630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.066723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 653/1287] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:29 2022] PUT /identity/v3/projects/f682372b91f14a878d08f5d3312efcef/users/187109ae45c74f19a26c320913a738b3/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:30.066723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6184839-324a-408b-b9b7-992260234b3a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.066723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6184839-324a-408b-b9b7-992260234b3a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.066723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6184839-324a-408b-b9b7-992260234b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.092198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d6184839-324a-408b-b9b7-992260234b3a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:30.093623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d6184839-324a-408b-b9b7-992260234b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.104983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b61fc097-683b-486f-9cdc-915944edd630 None None] MFA Rules not processed for user `94dd17b06cc140f7a48e1fdee39ece6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:30.106301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b61fc097-683b-486f-9cdc-915944edd630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.163458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 654/1288] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:30.163458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6184839-324a-408b-b9b7-992260234b3a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.163458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d6184839-324a-408b-b9b7-992260234b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.185402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 635/1289] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:30.190262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.190559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.190841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.227906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] MFA Rules not processed for user `187109ae45c74f19a26c320913a738b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:30.229357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.230663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6184839-324a-408b-b9b7-992260234b3a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.235788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.236347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.236663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.236952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.247763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.249241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.259787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 655/1290] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:30.266478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.269335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf5fe2-ece2-4fb7-ac9f-a840ae5bbe77 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.273493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54faea-5bb0-4b13-86a7-c09a3f427e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.274170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54faea-5bb0-4b13-86a7-c09a3f427e42 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.274452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54faea-5bb0-4b13-86a7-c09a3f427e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.274725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54faea-5bb0-4b13-86a7-c09a3f427e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.285889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54faea-5bb0-4b13-86a7-c09a3f427e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.288380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54faea-5bb0-4b13-86a7-c09a3f427e42 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.298691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 656/1291] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:30.300737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499b67-e73f-4578-950e-ef0ef69614e4 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.301182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499b67-e73f-4578-950e-ef0ef69614e4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.301612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499b67-e73f-4578-950e-ef0ef69614e4 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.308198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 657/1292] 10.222.0.13 () {54 vars in 961 bytes} [Fri Oct 14 03:07:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:07:30.309289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499b67-e73f-4578-950e-ef0ef69614e4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.309526 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 636/1293] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:30.313382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.320823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499b67-e73f-4578-950e-ef0ef69614e4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.324924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65a230-7cf6-44d1-8d07-9b18c1d90b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.325559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65a230-7cf6-44d1-8d07-9b18c1d90b72 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.325837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65a230-7cf6-44d1-8d07-9b18c1d90b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.326109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65a230-7cf6-44d1-8d07-9b18c1d90b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.337373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65a230-7cf6-44d1-8d07-9b18c1d90b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.339015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65a230-7cf6-44d1-8d07-9b18c1d90b72 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.349466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 658/1294] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:30.351733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.352026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.352300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.387134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6821e70-0294-4504-8aca-c3f152991dbe None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.392690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.393456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.393882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.394495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.399590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:30.401396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.406469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.408285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.427660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 637/1295] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:30.429594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.442843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62336aa-309c-4ecd-977a-352ac261c9ff service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.457045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.458966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.459210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.459490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.461213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.463471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.495623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 659/1296] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:30.505814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.516046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec15f0-14ef-473a-9a21-4dc5afa7505e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.523881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.524999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.525391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.525747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.624181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 638/1297] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:30.627059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.632557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.634433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.646049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 660/1298] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:30.678287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:30.724864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe175-544c-42fa-8f58-8981c7742fa7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.754581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb83d55-c7e6-444a-8950-cd4accc4369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.755507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb83d55-c7e6-444a-8950-cd4accc4369f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.756092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb83d55-c7e6-444a-8950-cd4accc4369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.756702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb83d55-c7e6-444a-8950-cd4accc4369f admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.758115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb83d55-c7e6-444a-8950-cd4accc4369f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.760816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb83d55-c7e6-444a-8950-cd4accc4369f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.921098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:30.936787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 639/1299] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:30.938858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f634a8-2958-4387-92ed-5791d2b0d9d7 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.940650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f634a8-2958-4387-92ed-5791d2b0d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.941102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f634a8-2958-4387-92ed-5791d2b0d9d7 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.951663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 640/1300] 10.222.0.13 () {54 vars in 912 bytes} [Fri Oct 14 03:07:30 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:07:30.953130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.953423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.953699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.954384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848ffaf-58ff-4675-b27a-f2327f128c20 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:30.964925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:30.965651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:30.965987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:30.966310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:30.967024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:30.970946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:30.992062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 661/1301] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:30.994542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:30.995804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:30.998130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:31.014423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a3a1-dbd9-4ee3-9b08-582001ac87da admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:31.033955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:31.034980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:31.035453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:31.035746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] PATH_INFO: `/v3/projects/0753cb53deeb4daf8ed2b7284dced999/users/0789736757d14eb9af17cea163d0e4bf/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:31.048922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:31.055766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0753cb53deeb4daf8ed2b7284dced999, user_id=0789736757d14eb9af17cea163d0e4bf, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:31.058956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:31.115160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 641/1302] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:31.129345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:31.166717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 662/1303] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:30 2022] PUT /identity/v3/projects/0753cb53deeb4daf8ed2b7284dced999/users/0789736757d14eb9af17cea163d0e4bf/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:31.169937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:31.218667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db640-1536-4bcb-bfda-81985f2f35bc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:31.259136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d1314-f96e-4449-903b-dfb11065978f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:31.279254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:31.280124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:31.280262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:31.280488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:31.285684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:31.285684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:31.300029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:31.302037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:31.302635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:31.303168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:31.316633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 663/1304] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:31.318684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:31.320831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:31.342159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980a66f-7cc2-44ff-86b1-64d70279415c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:31.360036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73afbbe-3468-474a-a96e-388c8a8e2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:31.360758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73afbbe-3468-474a-a96e-388c8a8e2409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:31.361046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73afbbe-3468-474a-a96e-388c8a8e2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:31.361327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73afbbe-3468-474a-a96e-388c8a8e2409 admin admin] PATH_INFO: `/v3/projects/0753cb53deeb4daf8ed2b7284dced999/users/0789736757d14eb9af17cea163d0e4bf/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:31.364064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73afbbe-3468-474a-a96e-388c8a8e2409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0753cb53deeb4daf8ed2b7284dced999, user_id=0789736757d14eb9af17cea163d0e4bf, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:31.371298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73afbbe-3468-474a-a96e-388c8a8e2409 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:31.419495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 664/1305] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:31 2022] PUT /identity/v3/projects/0753cb53deeb4daf8ed2b7284dced999/users/0789736757d14eb9af17cea163d0e4bf/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:31.421068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:31.421370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:31.421654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:31.451056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:31.452685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:31.456883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] MFA Rules not processed for user `0789736757d14eb9af17cea163d0e4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:31.458178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:31.478293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 642/1306] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:07:31.620544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 665/1307] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:31.663382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:31.683234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fa69-a944-44f1-8208-9e2a83394bf6 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:31.758808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ff311-1a05-417f-88ae-2d9039637221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:31.759684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff311-1a05-417f-88ae-2d9039637221 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:31.760068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff311-1a05-417f-88ae-2d9039637221 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:31.760418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ff311-1a05-417f-88ae-2d9039637221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:31.773398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ff311-1a05-417f-88ae-2d9039637221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:31.775494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ff311-1a05-417f-88ae-2d9039637221 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:31.800151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 643/1308] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:32.076320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:32.098458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:32.113605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee524710-5a65-4b60-9f70-9a4d091b8f40 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:32.120816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f511-71a0-431d-8ddb-5fb038e8d3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:32.122099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f511-71a0-431d-8ddb-5fb038e8d3fa service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:32.122597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f511-71a0-431d-8ddb-5fb038e8d3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:32.123073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f511-71a0-431d-8ddb-5fb038e8d3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:32.217076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4f511-71a0-431d-8ddb-5fb038e8d3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:32.221120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4f511-71a0-431d-8ddb-5fb038e8d3fa service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:32.252835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 666/1309] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:33.365383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367269-f1ef-41f9-b8df-76e09fb7b7d4 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:33.365383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367269-f1ef-41f9-b8df-76e09fb7b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:33.365383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367269-f1ef-41f9-b8df-76e09fb7b7d4 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:33.365383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 644/1310] 10.222.0.13 () {54 vars in 961 bytes} [Fri Oct 14 03:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:07:33.368939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c575-8c6c-406b-9b71-98c097493ca2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:33.368939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c575-8c6c-406b-9b71-98c097493ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:33.368939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c575-8c6c-406b-9b71-98c097493ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:33.384213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ac84c575-8c6c-406b-9b71-98c097493ca2 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:33.386184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ac84c575-8c6c-406b-9b71-98c097493ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:33.568112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 667/1311] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Oct 14 03:07:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:33.588158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc8a62-ace7-4b8f-aa73-47f967371c45 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:33.592518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc8a62-ace7-4b8f-aa73-47f967371c45 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:33.592997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc8a62-ace7-4b8f-aa73-47f967371c45 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:33.594629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 645/1312] 10.222.0.13 () {54 vars in 912 bytes} [Fri Oct 14 03:07:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:07:33.606641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:33.606928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:33.607206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:33.618850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:33.641301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:33.642650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:33.670104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 668/1313] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:07:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:33.684335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc8a62-ace7-4b8f-aa73-47f967371c45 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:33.690808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:33.699383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc8a62-ace7-4b8f-aa73-47f967371c45 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:33.704147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a2a03-ab38-4cb6-8d39-0198371ef349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:33.705025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a2a03-ab38-4cb6-8d39-0198371ef349 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:33.705495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a2a03-ab38-4cb6-8d39-0198371ef349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:33.706235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a2a03-ab38-4cb6-8d39-0198371ef349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:33.721934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a2a03-ab38-4cb6-8d39-0198371ef349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:33.723728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a2a03-ab38-4cb6-8d39-0198371ef349 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:33.746741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 646/1314] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:40.769050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:40.967401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab31a7e-8a1f-46db-91f0-4148bdec6ba1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:40.992991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:41.003105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:41.003105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:41.003105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] PATH_INFO: `/v3/users/b2b2b170e1ca4bb58e6547e728a7075d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:41.003105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2b2b170e1ca4bb58e6547e728a7075d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:41.004609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: WARNING py.warnings [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:07:41.004609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: warnings.warn(msg) Oct 14 03:07:41.004609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: Oct 14 03:07:41.005899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:41.339663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b2b170e1ca4bb58e6547e728a7075d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:41.369268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b2b170e1ca4bb58e6547e728a7075d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:41.424327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b2b170e1ca4bb58e6547e728a7075d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:41.432551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b2b170e1ca4bb58e6547e728a7075d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:41.539236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b2b170e1ca4bb58e6547e728a7075d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:41.554438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 669/1315] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:40 2022] DELETE /identity/v3/users/b2b2b170e1ca4bb58e6547e728a7075d => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:41.556225 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a2d2-92af-4b9e-97db-f7b77b8746b5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:41.556808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a2d2-92af-4b9e-97db-f7b77b8746b5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:41.556808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9a2d2-92af-4b9e-97db-f7b77b8746b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:41.622884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ddc9a2d2-92af-4b9e-97db-f7b77b8746b5 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:41.630653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ddc9a2d2-92af-4b9e-97db-f7b77b8746b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:41.740980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 647/1316] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:41.786315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:41.789757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:41.954431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe661adc-f87a-410c-910f-b709ee3a572f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:41.969418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571dd86-1d3b-4302-9e6f-49949c657aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:41.970581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571dd86-1d3b-4302-9e6f-49949c657aef service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:41.971724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571dd86-1d3b-4302-9e6f-49949c657aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:41.979029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571dd86-1d3b-4302-9e6f-49949c657aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:42.000886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571dd86-1d3b-4302-9e6f-49949c657aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:42.022693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571dd86-1d3b-4302-9e6f-49949c657aef service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:42.050194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 670/1317] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:42.741852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:42.744643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:42.745018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:42.809173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] MFA Rules not processed for user `ffc19ded49a74261b48bbe7c2a7f1904`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:42.810629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:43.091412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 648/1318] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:43.092784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:43.093273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:43.093394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:43.200421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] MFA Rules not processed for user `ffc19ded49a74261b48bbe7c2a7f1904`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:43.201748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:43.256901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 671/1319] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:43.268943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:43.270857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:43.542066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b91bb-6475-43ea-8c6d-f72075e0a8b0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:43.573682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa7ae-b745-4fcd-a3d8-9bbf50f3c2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:43.574242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7ae-b745-4fcd-a3d8-9bbf50f3c2f3 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:43.574779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7ae-b745-4fcd-a3d8-9bbf50f3c2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:43.575157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7ae-b745-4fcd-a3d8-9bbf50f3c2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:43.593918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfa7ae-b745-4fcd-a3d8-9bbf50f3c2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:43.596436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfa7ae-b745-4fcd-a3d8-9bbf50f3c2f3 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:43.647781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 649/1320] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:07:43.707982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:43.710291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:43.739462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30173b3c-efea-462a-81b6-50cb7912823c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:43.763124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:43.763804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:43.764114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:43.769500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] PATH_INFO: `/v3/projects/7023e0d1a56346108b270216bb5dc577` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:43.770950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7023e0d1a56346108b270216bb5dc577)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:43.774060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:43.793698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:44.023453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.024543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.025109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.037158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:44.094180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] MFA Rules not processed for user `2c196d842c4540b5800b4efa0ec4fc73`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:44.100510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:44.110237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7023e0d1a56346108b270216bb5dc577', 'request_id': 'req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:44.132002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7023e0d1a56346108b270216bb5dc577', 'request_id': 'req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:44.262317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7023e0d1a56346108b270216bb5dc577', 'request_id': 'req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:44.276586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 650/1321] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:07:44.283989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:44.286877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:44.289248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] The token cache is being invalidate because project 7023e0d1a56346108b270216bb5dc577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:07:44.293330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:44.293330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a6ed9c19-13c1-4c90-8d52-2f18f61990ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:44.294938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 672/1322] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:07:43 2022] DELETE /identity/v3/projects/7023e0d1a56346108b270216bb5dc577 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:44.307538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0899-c65f-403d-83da-51be85946daf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.307538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0899-c65f-403d-83da-51be85946daf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.307538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a0899-c65f-403d-83da-51be85946daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.383920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-470a0899-c65f-403d-83da-51be85946daf None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:44.387198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-470a0899-c65f-403d-83da-51be85946daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:44.603849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 673/1323] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:44.618842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c270a4-badd-4ec9-82ae-c9d2ad8a6b0d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.622787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c270a4-badd-4ec9-82ae-c9d2ad8a6b0d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.622787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c270a4-badd-4ec9-82ae-c9d2ad8a6b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.633927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485725e-a5e6-4bb7-ad78-b418d584091b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:44.652053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:44.652867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.653159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.653454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.665029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:44.707850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:44.711381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b6c270a4-badd-4ec9-82ae-c9d2ad8a6b0d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:44.712235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:44.715268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b6c270a4-badd-4ec9-82ae-c9d2ad8a6b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:44.763019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 651/1324] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:44.772116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 674/1325] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:44.774387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff2c5-a27b-4680-8ebd-b4bec70b5912 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.775670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:44.776139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff2c5-a27b-4680-8ebd-b4bec70b5912 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.778089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff2c5-a27b-4680-8ebd-b4bec70b5912 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.788213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 675/1326] 10.222.0.13 () {54 vars in 912 bytes} [Fri Oct 14 03:07:44 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:07:44.790000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.794100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.795343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.817061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921bde-78c1-4fc1-9e3f-26c8dab9bddf service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:44.832767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:44.834224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.834918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.835408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.836221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:44.837379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:44.848590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:44.901137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 652/1327] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:44.906084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:44.945655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cd964-e51d-4cdb-9238-cda225e50022 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:44.963573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:44.966762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:44.973099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:44.973931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:44.975653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:44.988292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:44.992245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.002442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.119894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 676/1328] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:07:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:45.126841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:45.129249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:45.165929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 653/1329] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:44 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:45.169888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:45.176179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:45.179393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0de7d-49f2-4422-a658-67b138df4da8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:45.273035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:45.292536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f269e7b-8c3b-4a61-9090-b8c6c01dd89f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:45.304266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:45.305282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.305899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.307538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.328306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.330766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.349143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 654/1330] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:45.350073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:45.353797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:45.354825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.355331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.355806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] PATH_INFO: `/v3/users/187109ae45c74f19a26c320913a738b3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.357592 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187109ae45c74f19a26c320913a738b3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.360826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.400817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a263ba-716b-42fd-b1eb-d48e2c53465b service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:45.407871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:45.408532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.408819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.409098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.410664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.412853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.582280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 655/1331] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:45 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:45.587301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:45.617356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76978628-fcc8-42d0-8496-da93a7053f4e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:45.643674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:45.646367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.646657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.646941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.647624 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.658909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.673427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187109ae45c74f19a26c320913a738b3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:45.693700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187109ae45c74f19a26c320913a738b3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:45.707207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 656/1332] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:45.713451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:45.732717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187109ae45c74f19a26c320913a738b3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:45.737449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187109ae45c74f19a26c320913a738b3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:45.745477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea529b-46c8-4fcb-8931-760ed7b37190 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:45.762923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:45.763550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.763832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.764110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.764793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.766424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.797113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 657/1333] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:45.798672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:45.800505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:45.835089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c51b1b-35dc-4f9c-8958-6a0e7508f202 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:45.849161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88a87a-9b9e-45bf-92a2-e324b01bb4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:45.850143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a87a-9b9e-45bf-92a2-e324b01bb4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.850143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a87a-9b9e-45bf-92a2-e324b01bb4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.850388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:45.850492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88a87a-9b9e-45bf-92a2-e324b01bb4e2 admin admin] PATH_INFO: `/v3/projects/73fd58ebd90a4dfe8b72669b52163621/users/624fca149e234d12a92dd053e96b0972/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.872104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1033f04a-68cb-49cb-be89-1350177a2776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187109ae45c74f19a26c320913a738b3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:45.883911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 677/1334] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:45 2022] DELETE /identity/v3/users/187109ae45c74f19a26c320913a738b3 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:45.885694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.887115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.887618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:45.888794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88a87a-9b9e-45bf-92a2-e324b01bb4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fd58ebd90a4dfe8b72669b52163621, user_id=624fca149e234d12a92dd053e96b0972, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:45.891673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88a87a-9b9e-45bf-92a2-e324b01bb4e2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:45.926709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:45.929964 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:45.991268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 658/1335] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:45 2022] PUT /identity/v3/projects/73fd58ebd90a4dfe8b72669b52163621/users/624fca149e234d12a92dd053e96b0972/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:07:45.994393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:45.994806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:45.995142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:46.056305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] MFA Rules not processed for user `624fca149e234d12a92dd053e96b0972`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:46.056305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:46.120713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 678/1336] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:46.122668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:46.127630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:46.170364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f11df7-4ca6-4ac0-8d2f-8492852d14e7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:46.270570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 659/1337] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:07:46.270570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:46.270570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:46.376081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:46.377135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:46.377471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:46.377762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] PATH_INFO: `/v3/users/94dd17b06cc140f7a48e1fdee39ece6b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:46.379171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dd17b06cc140f7a48e1fdee39ece6b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:46.398168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:46.444781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df833de-afe3-44f1-8209-b38bd87cca0a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:46.672687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:46.672687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:46.672687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:46.672687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:46.684908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:46.684908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:46.684908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 660/1338] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:46.684908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:46.684908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:46.684908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5235c-8e6e-457c-9b06-648d8d94fd40 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:46.688625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:46.688625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:46.688625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:46.688625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:46.689158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:46.699442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:46.701769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dd17b06cc140f7a48e1fdee39ece6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:46.702869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:46.720835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 661/1339] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:46.722775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:46.741399 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dd17b06cc140f7a48e1fdee39ece6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:46.750201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf086ef9-8d5f-425a-be48-8310ba2e51b0 service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:46.758068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dd17b06cc140f7a48e1fdee39ece6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:46.760788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dd17b06cc140f7a48e1fdee39ece6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:46.763294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:46.764299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:46.764299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:46.764713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:46.765476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:46.769761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:46.888198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-77eb63af-e0f2-4a9a-b5a9-4fafc16e79a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dd17b06cc140f7a48e1fdee39ece6b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:46.895025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 679/1340] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:46 2022] DELETE /identity/v3/users/94dd17b06cc140f7a48e1fdee39ece6b => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:46.900563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:46.901169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:46.901589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:46.909875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 662/1341] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:46 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:46.913552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:46.918666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:46.982689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:46.987033 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:47.131990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b52c1-b2e3-4cc1-bd1b-d5f4c2a8e467 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:47.148994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:47.155234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.155234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.155234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.156413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:47.162094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:47.177244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:47.193076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 680/1342] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:47.271807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 663/1343] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:46 2022] POST /identity/v3/users => generated 292 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:47.275869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:47.292545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bb225-0370-46b7-85db-4e2c2e0aa9a1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:47.303568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:47.304209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.304522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.304836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.305725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:47.307449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:47.329643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:47.333109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:47.350594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 681/1344] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:47.351791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:47.384998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe97dc-8fe2-4851-bc6a-18cb0d184d2c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:47.396974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:47.397955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.398427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.399315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] PATH_INFO: `/v3/projects/64c37ff91ad94a76851262ba2d6fbbd2/users/3237cc69869d4dfaad7940a396b79553/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.452891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c37ff91ad94a76851262ba2d6fbbd2, user_id=3237cc69869d4dfaad7940a396b79553, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:47.457505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:47.487597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d9206-3ac0-4b35-be41-bdd740490acc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:47.502112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:47.503207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.503725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.504235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.533219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:47.534400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:47.562407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 664/1345] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:07:47.568783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 682/1346] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:47 2022] PUT /identity/v3/projects/64c37ff91ad94a76851262ba2d6fbbd2/users/3237cc69869d4dfaad7940a396b79553/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:47.570311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:47.584539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb8670-aa72-43cd-ae11-1d405c7ef537 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:47.696365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39637f7-0c08-45f2-8dc8-266d5de2e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:47.697301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39637f7-0c08-45f2-8dc8-266d5de2e99f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.697639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39637f7-0c08-45f2-8dc8-266d5de2e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.698003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39637f7-0c08-45f2-8dc8-266d5de2e99f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.701745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39637f7-0c08-45f2-8dc8-266d5de2e99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:47.708999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39637f7-0c08-45f2-8dc8-266d5de2e99f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:47.718788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 665/1347] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:07:47.723143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:47.736798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710235f-0a29-4de3-aa3d-157473ea29d7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:47.742641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:47.743862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.744226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.744954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] PATH_INFO: `/v3/projects/64c37ff91ad94a76851262ba2d6fbbd2/users/3237cc69869d4dfaad7940a396b79553/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.747319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c37ff91ad94a76851262ba2d6fbbd2, user_id=3237cc69869d4dfaad7940a396b79553, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:47.750354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:47.766293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 683/1348] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:47 2022] PUT /identity/v3/projects/64c37ff91ad94a76851262ba2d6fbbd2/users/3237cc69869d4dfaad7940a396b79553/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:47.777227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:47.778238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:47.778813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:47.871604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] MFA Rules not processed for user `3237cc69869d4dfaad7940a396b79553`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:47.873729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:48.027779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 666/1349] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:48.042908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:48.045375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:48.199051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00bd92-4b59-420c-ae2e-a16b66b867bd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:48.213080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:48.214257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:48.215078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:48.215657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:48.236886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:48.238364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:48.266718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 684/1350] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:48.957253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:48.958760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:49.027240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:49.070701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4af900-5d65-4299-be0c-76e30ee51adb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:49.088903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:49.089587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:49.090012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:49.090298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] PATH_INFO: `/v3/projects/f682372b91f14a878d08f5d3312efcef` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:49.091566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f682372b91f14a878d08f5d3312efcef)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:49.092661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: WARNING py.warnings [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 14 03:07:49.092661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: warnings.warn(msg) Oct 14 03:07:49.092661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: Oct 14 03:07:49.093886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:49.122081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:49.294581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f682372b91f14a878d08f5d3312efcef', 'request_id': 'req-cdabcb53-339e-4d15-b238-28a8075961dc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.307364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f682372b91f14a878d08f5d3312efcef', 'request_id': 'req-cdabcb53-339e-4d15-b238-28a8075961dc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.321729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f682372b91f14a878d08f5d3312efcef', 'request_id': 'req-cdabcb53-339e-4d15-b238-28a8075961dc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.400184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] The token cache is being invalidate because project f682372b91f14a878d08f5d3312efcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:07:49.400582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.403214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.407499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 667/1351] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:07:48 2022] DELETE /identity/v3/projects/f682372b91f14a878d08f5d3312efcef => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:49.409684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:49.439234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d04170-3ba4-41e8-ab4b-d2151d46dbb8 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:49.540579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:49.542081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:49.542587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:49.543097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] PATH_INFO: `/v3/users/0789736757d14eb9af17cea163d0e4bf` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:49.546108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0789736757d14eb9af17cea163d0e4bf)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:49.549736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:49.841842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:49.841842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:49.844344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0789736757d14eb9af17cea163d0e4bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.856523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabcb53-339e-4d15-b238-28a8075961dc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:49.858396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0789736757d14eb9af17cea163d0e4bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.879699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:49.882121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:49.883642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:49.885522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] PATH_INFO: `/v3/users/624fca149e234d12a92dd053e96b0972` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:49.891105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624fca149e234d12a92dd053e96b0972)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:49.894564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:49.905734 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0789736757d14eb9af17cea163d0e4bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:49.907255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0789736757d14eb9af17cea163d0e4bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.007622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-09095d79-e31d-47db-b43f-35dba284c5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0789736757d14eb9af17cea163d0e4bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.016752 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 685/1352] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:49 2022] DELETE /identity/v3/users/0789736757d14eb9af17cea163d0e4bf => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:50.018829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeb5f0-7b71-4e95-b90c-fec09e548ce6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:50.019330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeb5f0-7b71-4e95-b90c-fec09e548ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:50.019807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eeb5f0-7b71-4e95-b90c-fec09e548ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:50.097887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-25eeb5f0-7b71-4e95-b90c-fec09e548ce6 None None] MFA Rules not processed for user `4553b7573ca34af6a9fdb94f80717f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:50.099920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-25eeb5f0-7b71-4e95-b90c-fec09e548ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:50.188622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624fca149e234d12a92dd053e96b0972'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.206980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624fca149e234d12a92dd053e96b0972'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.208316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624fca149e234d12a92dd053e96b0972'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.224211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 686/1353] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:50.224211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:50.224560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:50.224977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:50.268412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] MFA Rules not processed for user `1201fb5f14154b048f5c55bd566e91b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:50.269967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:50.310156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624fca149e234d12a92dd053e96b0972'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.338027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-10b3cc59-39df-4bf9-96b9-0f71fbfe6f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624fca149e234d12a92dd053e96b0972'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.361317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 668/1354] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:49 2022] DELETE /identity/v3/users/624fca149e234d12a92dd053e96b0972 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:07:50.362873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:50.363405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:50.364004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:50.416541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] MFA Rules not processed for user `2c196d842c4540b5800b4efa0ec4fc73`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:50.418981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:50.434111 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 687/1355] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:50.435597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:50.437333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:50.496509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:50.554780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 669/1356] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:50.561658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:50.563045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:50.564130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7f3c4-80cf-4093-8d2d-5a8d8c6ec0ca None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:50.648974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a25e65-2aaa-4004-a8e4-05ffa9d4b0ae None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:50.664290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:50.665078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:50.665428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:50.665787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] PATH_INFO: `/v3/projects/2a03d2fd7e4e49e9a521cf2cc6a65e99` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:50.667024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a03d2fd7e4e49e9a521cf2cc6a65e99)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:50.669078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:50.771882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:50.773112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:50.773540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:50.773978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:50.777778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:50.845830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:50.897166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a03d2fd7e4e49e9a521cf2cc6a65e99', 'request_id': 'req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.914104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a03d2fd7e4e49e9a521cf2cc6a65e99', 'request_id': 'req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.926481 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a03d2fd7e4e49e9a521cf2cc6a65e99', 'request_id': 'req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:50.943794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:50.954635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed92f919-ac59-48b4-87ca-465d559fffac service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:50.996052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 688/1357] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:50.996052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e140f3-a6bc-436e-a5a9-6c8d9d0ab8c9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:50.996052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e140f3-a6bc-436e-a5a9-6c8d9d0ab8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.006047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e140f3-a6bc-436e-a5a9-6c8d9d0ab8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.019223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] The token cache is being invalidate because project 2a03d2fd7e4e49e9a521cf2cc6a65e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:07:51.019223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.026344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.026344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 670/1358] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:07:50 2022] DELETE /identity/v3/projects/2a03d2fd7e4e49e9a521cf2cc6a65e99 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:51.026344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:51.027483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.087776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b3e140f3-a6bc-436e-a5a9-6c8d9d0ab8c9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:51.093970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b3e140f3-a6bc-436e-a5a9-6c8d9d0ab8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.214645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 689/1359] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:51.216666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3e91a-09a0-4493-87f3-092a4b7b929e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:51.216955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3e91a-09a0-4493-87f3-092a4b7b929e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.218664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3e91a-09a0-4493-87f3-092a4b7b929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.258529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6b79-f0e0-4290-bea2-ed4baf64b422 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:51.281589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:51.282179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d8e3e91a-09a0-4493-87f3-092a4b7b929e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:51.282298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:51.282575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.282862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.283396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d8e3e91a-09a0-4493-87f3-092a4b7b929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.291252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.314411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 690/1360] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:51.319016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:51.319497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.319971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.383628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] MFA Rules not processed for user `dbf0723a0f3942d2b9b2554320878016`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:51.383628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.487664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:51.491665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:51.505556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 671/1361] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:51.507007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:51.508849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.589777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 691/1362] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:51.590679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:51.593138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.620991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb84ca9-42db-400a-872c-d2306a02af1d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:51.627332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:51.628002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:51.628541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.630472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] PATH_INFO: `/v3/projects/0753cb53deeb4daf8ed2b7284dced999` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.631874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0753cb53deeb4daf8ed2b7284dced999)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:51.633948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:51.643175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20432d-8965-433f-97dd-de8cb00a79c5 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:51.655053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d66685-aed1-4921-bf6a-d50373c5f2d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:51.656002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d66685-aed1-4921-bf6a-d50373c5f2d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:51.657027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d66685-aed1-4921-bf6a-d50373c5f2d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.657413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d66685-aed1-4921-bf6a-d50373c5f2d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.684208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d66685-aed1-4921-bf6a-d50373c5f2d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:51.695600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d66685-aed1-4921-bf6a-d50373c5f2d6 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:51.729054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 672/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:51.731544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a20b1-585b-47cc-8160-d770ec630a27 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:51.731939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a20b1-585b-47cc-8160-d770ec630a27 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:51.733620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a20b1-585b-47cc-8160-d770ec630a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:51.795873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0753cb53deeb4daf8ed2b7284dced999', 'request_id': 'req-56e62ce5-f536-4b04-9e60-c4f279429d4a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.799797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3a1a20b1-585b-47cc-8160-d770ec630a27 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:51.802859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3a1a20b1-585b-47cc-8160-d770ec630a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:51.828199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0753cb53deeb4daf8ed2b7284dced999', 'request_id': 'req-56e62ce5-f536-4b04-9e60-c4f279429d4a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.839308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:51.960165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0753cb53deeb4daf8ed2b7284dced999', 'request_id': 'req-56e62ce5-f536-4b04-9e60-c4f279429d4a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.978163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] The token cache is being invalidate because project 0753cb53deeb4daf8ed2b7284dced999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:07:51.983143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.988706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-56e62ce5-f536-4b04-9e60-c4f279429d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:51.991913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 692/1364] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:07:51 2022] DELETE /identity/v3/projects/0753cb53deeb4daf8ed2b7284dced999 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:52.001959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.001959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.001959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.065809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 673/1365] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:52.072103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.072457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.072746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.098047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] MFA Rules not processed for user `dbf0723a0f3942d2b9b2554320878016`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:52.100890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:52.157442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:52.158663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:52.180806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 674/1366] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:52.181744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:52.199221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d00428-4cbe-4086-97e3-e0833977f8d9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:52.217986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:52.218623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.218905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.219177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.219886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:52.220206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:52.222119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193e2a6-eb09-4190-a1f3-78ee3748eb3d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:52.242840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 675/1367] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:52.244329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeab41a-8a31-4e65-a58c-3bc7f7b741ce None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.244652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeab41a-8a31-4e65-a58c-3bc7f7b741ce None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.244930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeab41a-8a31-4e65-a58c-3bc7f7b741ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.292857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-deeab41a-8a31-4e65-a58c-3bc7f7b741ce None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:52.294099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-deeab41a-8a31-4e65-a58c-3bc7f7b741ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:52.306290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 693/1368] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:52.306290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:52.327106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 676/1369] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:52.327106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.327106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.327106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.346447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f2ec8-46b0-42b7-907d-08f378df6419 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:52.362718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:52.367026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.370443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.370443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.370443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:52.392733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:52.544272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 694/1370] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:52 2022] POST /identity/v3/projects => generated 365 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:52.548706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:52.643349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ec2c-0657-4a25-bf63-550888d4913f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:52.651457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:52.652197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.652809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.653183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.653950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:52.654364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:52.657728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87cb23-9543-4e83-9453-b715fad4fa75 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:52.663571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:52.697137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 695/1371] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:52.697137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44b21-2746-42e0-a261-61459cde2032 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.697137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44b21-2746-42e0-a261-61459cde2032 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.697435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44b21-2746-42e0-a261-61459cde2032 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.699901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 696/1372] 10.222.0.13 () {54 vars in 912 bytes} [Fri Oct 14 03:07:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:07:52.702009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca44b21-2746-42e0-a261-61459cde2032 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:52.704606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3ca44b21-2746-42e0-a261-61459cde2032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:52.713133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:52.716239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:52.854821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 677/1373] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:07:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:52.855750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:52.873433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca44b21-2746-42e0-a261-61459cde2032 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:52.880446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc6d51-a59a-4bbc-b8eb-bbcbd99ddfb7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:52.883137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:52.884016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.884569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.886235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.889216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:52.902629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0184393-834e-4b49-87e8-6c72220ba2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:52.902629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0184393-834e-4b49-87e8-6c72220ba2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:52.902629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0184393-834e-4b49-87e8-6c72220ba2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:52.902629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0184393-834e-4b49-87e8-6c72220ba2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:52.903011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0184393-834e-4b49-87e8-6c72220ba2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:52.906517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0184393-834e-4b49-87e8-6c72220ba2f1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.010164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.011796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.027143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 697/1374] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:53.028356 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.041863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e490a-2de9-444d-a203-b7fae78284cd service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.047874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.048742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.049108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.049500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.050660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.052945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.058402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 678/1375] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:52 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:53.059924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.060403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.060834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.114831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:53.117400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.143294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 698/1376] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:53 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:53.143294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.261739 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 679/1377] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:07:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:53.262780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.266678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.309810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d964350-8443-44c6-bf44-f3dbf0146e7b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.322306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18200441-de5e-401c-a122-5a8f4649abe7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.326940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.327891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.328365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.328935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] PATH_INFO: `/v3/projects/73fd58ebd90a4dfe8b72669b52163621` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.333876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fd58ebd90a4dfe8b72669b52163621)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.336588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.344027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.346274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.348444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.357831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.358738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.360785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.390508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 699/1378] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:53.391495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.414879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdedd7-6fa6-4103-b6f0-4326c11f9e21 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.422625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.422954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.423271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.423549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.424342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.426621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.535809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 700/1379] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:53 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:53.537479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.581214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fd58ebd90a4dfe8b72669b52163621', 'request_id': 'req-3be0f260-d037-406b-984f-6c95752911d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:53.582375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1e2f-53d1-4667-aec2-f6db9e41d3ac admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.616169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fd58ebd90a4dfe8b72669b52163621', 'request_id': 'req-3be0f260-d037-406b-984f-6c95752911d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:53.635352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fd58ebd90a4dfe8b72669b52163621', 'request_id': 'req-3be0f260-d037-406b-984f-6c95752911d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:53.714021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.715271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.715271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.715271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.715885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.718060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.731826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 701/1380] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:53.736654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:53.746374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] The token cache is being invalidate because project 73fd58ebd90a4dfe8b72669b52163621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:07:53.746608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:53.747597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:53.748359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.749233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 680/1381] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:07:53 2022] DELETE /identity/v3/projects/73fd58ebd90a4dfe8b72669b52163621 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:53.750545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.751000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.754041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.782908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0f260-d037-406b-984f-6c95752911d8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.793541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.794173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.794455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.794732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.795405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.797053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:53.822724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 681/1382] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:53.823394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:53.833558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.881624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86da6-14d5-4a6b-b166-ccf2aa8dc042 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.890136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.891042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.891464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.895038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.895038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.957369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d5296-54aa-4c43-aa82-8623f02f5b62 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:53.974748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:53.975380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:53.975660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:53.975939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:53.982500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:53.996511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:53.997929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:54.023197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 682/1383] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:54.024059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:54.033465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:54.073172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:54.074863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7987d6-1d05-469b-9031-102ffee3abfe service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:54.074988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:54.086029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:54.086709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:54.086988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:54.087262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] PATH_INFO: `/v3/projects/775de2e52eac4e96b4d7ba14dde4edfc/users/5fcd9dfded9b4f6f8110165a678e896f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:54.116035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 702/1384] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:07:54.117997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:54.120538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:54.141858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775de2e52eac4e96b4d7ba14dde4edfc, user_id=5fcd9dfded9b4f6f8110165a678e896f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:54.144754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:54.148429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eafe9-86ab-4ca7-8451-5354a4591f5e service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:54.157760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:54.158413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:54.158700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:54.158981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] PATH_INFO: `/v3/users/3237cc69869d4dfaad7940a396b79553` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:54.160519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3237cc69869d4dfaad7940a396b79553)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:54.165942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:54.254812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 683/1385] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:54 2022] PUT /identity/v3/projects/775de2e52eac4e96b4d7ba14dde4edfc/users/5fcd9dfded9b4f6f8110165a678e896f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:54.254812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:54.405780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e9986-983b-4762-97be-a63a2570eae0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:54.424834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1155fe-9fcc-4561-8c20-040a3dc9c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:54.426078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1155fe-9fcc-4561-8c20-040a3dc9c0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:54.426393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1155fe-9fcc-4561-8c20-040a3dc9c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:54.427201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1155fe-9fcc-4561-8c20-040a3dc9c0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:54.433347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1155fe-9fcc-4561-8c20-040a3dc9c0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:54.436580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1155fe-9fcc-4561-8c20-040a3dc9c0d7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:54.466028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3237cc69869d4dfaad7940a396b79553'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:54.466669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 684/1386] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:54.468114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:54.468476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:54.468786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:54.494848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3237cc69869d4dfaad7940a396b79553'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:54.554666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] MFA Rules not processed for user `5fcd9dfded9b4f6f8110165a678e896f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:54.561947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3237cc69869d4dfaad7940a396b79553'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:54.570650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:54.585108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3237cc69869d4dfaad7940a396b79553'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:54.825071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3237cc69869d4dfaad7940a396b79553'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:54.831434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 685/1387] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:54.833352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:54.838572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:54.846049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 703/1388] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:54 2022] DELETE /identity/v3/users/3237cc69869d4dfaad7940a396b79553 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:54.847140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:54.851305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:54.870768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5399753-f254-44a1-a7c0-6c463383e782 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:54.975813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:55.034116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8e933-78d4-411a-8d25-c37ff79758c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:55.035027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e933-78d4-411a-8d25-c37ff79758c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.035409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e933-78d4-411a-8d25-c37ff79758c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.035856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8e933-78d4-411a-8d25-c37ff79758c3 admin admin] PATH_INFO: `/v3/projects/7444de5a54c244f6956ff269f5f9abda/users/e800e1c8ad38460d90e029a2e8f05765/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.088085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8e933-78d4-411a-8d25-c37ff79758c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7444de5a54c244f6956ff269f5f9abda, user_id=e800e1c8ad38460d90e029a2e8f05765, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:55.091091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8e933-78d4-411a-8d25-c37ff79758c3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:55.120698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d89c34-1284-4803-8195-a5f003a85be1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:55.153289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d8844-ad2f-4fb8-9dcc-0a6f1067449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:55.153978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8844-ad2f-4fb8-9dcc-0a6f1067449c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.154267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8844-ad2f-4fb8-9dcc-0a6f1067449c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.156946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d8844-ad2f-4fb8-9dcc-0a6f1067449c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.157633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d8844-ad2f-4fb8-9dcc-0a6f1067449c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:55.161853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d8844-ad2f-4fb8-9dcc-0a6f1067449c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:55.277455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 686/1389] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:54 2022] PUT /identity/v3/projects/7444de5a54c244f6956ff269f5f9abda/users/e800e1c8ad38460d90e029a2e8f05765/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:55.279281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.281744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.282325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.311074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 704/1390] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:54 2022] POST /identity/v3/projects => generated 363 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:55.313805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.314114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.322847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.347078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:55.348754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:55.400065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] MFA Rules not processed for user `e800e1c8ad38460d90e029a2e8f05765`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:55.401437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:55.505372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:55.701101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 687/1391] 10.222.0.44 () {58 vars in 1015 bytes} [Fri Oct 14 03:07:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:55.701101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:55.711605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 705/1392] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:55.715181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:55.724748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:55.772957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3903a07-f715-4c16-adef-38ad4a2ecd24 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:55.800571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:55.803649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.804066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.805390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.811417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc94bb-a8f3-494a-8afd-c52b7687a597 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:55.843145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:55.844007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:55.844129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:55.844217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.844217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.844217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.849955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:55.853113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:55.886625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 706/1393] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:55.889318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:55.933286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435dfc3-39d5-4bbc-b143-b4f525523a46 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:55.947541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:55.963628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:55.966818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:55.967215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:55.968030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:55.978410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:55.999437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 688/1394] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:55 2022] POST /identity/v3/users => generated 288 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:56.004051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:56.030121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee259050-2623-46fb-8bdd-837eed019ca0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:56.069449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:56.073866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.074586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.078598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.081678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:56.091694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:56.123423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 689/1395] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:56.129819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:56.153757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80760b3f-7809-42ad-951d-79b164125408 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:56.162426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 707/1396] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:55 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:56.166484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:56.167049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:56.167735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.168037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.168792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] PATH_INFO: `/v3/projects/98dcd2fba50b467f9c04958ffcf070df/users/e39cd26f4d94497d99972dcf99143794/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.248258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dcd2fba50b467f9c04958ffcf070df, user_id=e39cd26f4d94497d99972dcf99143794, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:56.253967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:56.307784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:56.377919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 690/1397] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:56 2022] PUT /identity/v3/projects/98dcd2fba50b467f9c04958ffcf070df/users/e39cd26f4d94497d99972dcf99143794/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:56.387021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:56.487709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fe698-94a9-41cd-b277-5885f7936778 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:56.618531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:56.703755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:56.712172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14035-fdbe-4bca-823c-f2a549b77487 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:56.723545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.723545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.723545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.724193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:56.730119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:56.750802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:56.751826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.752252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.752564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.753554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:56.762949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:56.813180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 691/1398] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:56.815443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:56.844698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 708/1399] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:56 2022] POST /identity/v3/users => generated 300 bytes in 678 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:56.850095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:56.850266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f399d5-fba5-44bd-9b41-b5e5c00c17ae admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:56.867869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abb9a0-f7b7-4258-895a-88fc8c5b14af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:56.868933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb9a0-f7b7-4258-895a-88fc8c5b14af admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.869377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb9a0-f7b7-4258-895a-88fc8c5b14af admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.869793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abb9a0-f7b7-4258-895a-88fc8c5b14af admin admin] PATH_INFO: `/v3/projects/98dcd2fba50b467f9c04958ffcf070df/users/e39cd26f4d94497d99972dcf99143794/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.874709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb9a0-f7b7-4258-895a-88fc8c5b14af admin admin] RBAC: Authorizing `identity:create_grant(project_id=98dcd2fba50b467f9c04958ffcf070df, user_id=e39cd26f4d94497d99972dcf99143794, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:56.880926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abb9a0-f7b7-4258-895a-88fc8c5b14af admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:56.895063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4cfb-ec71-42d0-a1da-bb8182e38943 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:56.899195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:56.920032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 692/1400] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:56 2022] PUT /identity/v3/projects/98dcd2fba50b467f9c04958ffcf070df/users/e39cd26f4d94497d99972dcf99143794/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:07:56.931478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.931767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.932045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.939414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:56.939414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:56.939414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:56.940005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:56.945132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:56.951947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:56.998241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] MFA Rules not processed for user `e39cd26f4d94497d99972dcf99143794`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:57.000054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:57.014354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 709/1401] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:07:57.022570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:57.069390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fc096-5b8f-488c-aeeb-84d77522b85d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:57.104363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 693/1402] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:57.118741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:57.122035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:57.275303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9627e2-62de-4559-9b7c-0f57edbb9881 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:57.288416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f57932-d89a-4b14-8562-e5827383d150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:57.289146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f57932-d89a-4b14-8562-e5827383d150 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:57.289505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f57932-d89a-4b14-8562-e5827383d150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:57.289851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f57932-d89a-4b14-8562-e5827383d150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:57.296943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:57.297660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:57.297998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:57.298285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] PATH_INFO: `/v3/projects/f4a05c24e45f427b834f94cb0c3dcfd5/users/5eb69b328ccb4237a2424ccd4e0af528/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:57.313598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f57932-d89a-4b14-8562-e5827383d150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:57.315715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f57932-d89a-4b14-8562-e5827383d150 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:57.344031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 694/1403] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:57.346236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:57.346919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:57.347896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:57.402466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a05c24e45f427b834f94cb0c3dcfd5, user_id=5eb69b328ccb4237a2424ccd4e0af528, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:57.408538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:57.414683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] MFA Rules not processed for user `dbf0723a0f3942d2b9b2554320878016`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:57.420589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:57.513497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 695/1404] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:57.513497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:57.514943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:57.550462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243c30-fe06-4016-840b-3405008d1e4b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:57.562400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:57.563440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:57.563942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:57.564469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] PATH_INFO: `/v3/projects/64c37ff91ad94a76851262ba2d6fbbd2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:57.566037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c37ff91ad94a76851262ba2d6fbbd2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:57.569037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:57.676897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 710/1405] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:57 2022] PUT /identity/v3/projects/f4a05c24e45f427b834f94cb0c3dcfd5/users/5eb69b328ccb4237a2424ccd4e0af528/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:57.680616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:57.769442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c37ff91ad94a76851262ba2d6fbbd2', 'request_id': 'req-527fe874-95e1-45f5-89ac-5d9633ad0bd5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:57.971732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c37ff91ad94a76851262ba2d6fbbd2', 'request_id': 'req-527fe874-95e1-45f5-89ac-5d9633ad0bd5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:57.971732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c37ff91ad94a76851262ba2d6fbbd2', 'request_id': 'req-527fe874-95e1-45f5-89ac-5d9633ad0bd5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:57.973210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7229950-bd80-4bb8-851f-bd15cb04ad0a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:57.978863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:57.979514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:57.979797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:57.980072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:57.980803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:57.982452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:58.016703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 711/1406] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:07:58.016703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:58.035751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4718c0-604e-4b5e-adcb-cd28a1a069af admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:58.043817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:58.045140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.045496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.045916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] PATH_INFO: `/v3/projects/f4a05c24e45f427b834f94cb0c3dcfd5/users/5eb69b328ccb4237a2424ccd4e0af528/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.048511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a05c24e45f427b834f94cb0c3dcfd5, user_id=5eb69b328ccb4237a2424ccd4e0af528, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:58.051598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:58.080245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 712/1407] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:58 2022] PUT /identity/v3/projects/f4a05c24e45f427b834f94cb0c3dcfd5/users/5eb69b328ccb4237a2424ccd4e0af528/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:58.092777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:58.193462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] The token cache is being invalidate because project 64c37ff91ad94a76851262ba2d6fbbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:07:58.196157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:58.197456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-527fe874-95e1-45f5-89ac-5d9633ad0bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:58.204107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 696/1408] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:07:57 2022] DELETE /identity/v3/projects/64c37ff91ad94a76851262ba2d6fbbd2 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:58.206229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.207411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.208428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.232669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f263f-8c3d-4956-b479-93561b3453a6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:58.237605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:58.239204 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.239645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.240067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.243998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:58.355168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] MFA Rules not processed for user `5eb69b328ccb4237a2424ccd4e0af528`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:58.357296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:58.432602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:58.434510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dda562-187d-4eb4-a637-2ca2aaf804f1 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:58.465923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 713/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:58.467441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.468497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.468497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.518762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:58.524807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:58.527824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 697/1410] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:58.542383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:58.547294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:58.603524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccc35f-a85c-44e3-b369-c86ae1ffa781 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:58.620094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217faecc-ff7a-43d8-9f67-2dee17d72904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:58.620806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faecc-ff7a-43d8-9f67-2dee17d72904 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.621087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faecc-ff7a-43d8-9f67-2dee17d72904 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.621358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217faecc-ff7a-43d8-9f67-2dee17d72904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.665908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faecc-ff7a-43d8-9f67-2dee17d72904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:58.668005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217faecc-ff7a-43d8-9f67-2dee17d72904 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:58.697348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 698/1411] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:07:58.721109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 714/1412] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:58.730384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.730805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.731177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.782504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:58.784070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:58.797017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 699/1413] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:58.801936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:58.817238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6efa7-eac9-42a0-ac66-39c0e460d420 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:58.841594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:58.843795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:58.855624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:58.857851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.857851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.857851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.857851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:07:58.861278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:58.863199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:58.870367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5e66-b835-4b24-a2b4-d277022db144 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:58.886233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:58.888470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.888631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 715/1414] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:07:58.889264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.889683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] PATH_INFO: `/v3/users/e800e1c8ad38460d90e029a2e8f05765` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.891093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e800e1c8ad38460d90e029a2e8f05765)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:58.892832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:58.894084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:58.904489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:58.911555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016df9d-6dd5-4769-b507-9a128fd5fa83 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:58.918038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:58.919982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:58.920323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:58.920860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:58.921615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:58.924198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:59.288183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 716/1415] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:07:58 2022] POST /identity/v3/projects => generated 367 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:59.289064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:59.465198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b799c5-2538-49b1-adc3-1ba5651ed98d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:59.469305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e800e1c8ad38460d90e029a2e8f05765'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:59.500899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e800e1c8ad38460d90e029a2e8f05765'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:59.501228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:59.502371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:59.502533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e800e1c8ad38460d90e029a2e8f05765'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:59.502985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:59.503439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:59.504508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:59.509561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:59.635633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e800e1c8ad38460d90e029a2e8f05765'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:59.660079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 717/1416] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:07:59 2022] POST /identity/v3/users => generated 284 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:07:59.662883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:59.667501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b72b47bd-d59a-4772-bd24-e7f63bed9cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e800e1c8ad38460d90e029a2e8f05765'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:07:59.668675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:59.702892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 700/1417] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:07:58 2022] DELETE /identity/v3/users/e800e1c8ad38460d90e029a2e8f05765 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:07:59.703507 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e738f9-6d00-4e58-83c5-424873f5d084 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:59.704649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:59.704934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:59.705208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:59.759446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:07:59.760881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:59.865384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:59.865384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:59.865384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:59.865384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:59.866058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:59.866058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:59.866058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 718/1418] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:59.868172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:59.890468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec2c7-57a5-4f36-b3bf-ad4d00c994c2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:59.904967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:59.904967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:59.904967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:59.904967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:07:59.905268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:07:59.905268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:07:59.918913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 719/1419] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:07:59.932364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:59.944790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 701/1420] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:07:59.956654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:07:59.960483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:07:59.967764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:07:59.968099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e22f-3ad7-4dab-8811-d5cfdac5a26f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:07:59.984644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5fb88-a483-497e-a4e1-97a0698117fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:07:59.985594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb88-a483-497e-a4e1-97a0698117fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:07:59.985852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb88-a483-497e-a4e1-97a0698117fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:07:59.986201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5fb88-a483-497e-a4e1-97a0698117fc admin admin] PATH_INFO: `/v3/projects/944736323c6d481e999b8dab361b320b/users/84bfec29a8d34425a94bc661895b42f4/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:00.048940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036bb91-64fa-43db-9679-3b2b7194f36a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:00.055331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157dcf7-9a31-45fa-a950-f8c423ddc547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:00.055979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157dcf7-9a31-45fa-a950-f8c423ddc547 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:00.056362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157dcf7-9a31-45fa-a950-f8c423ddc547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:00.056691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157dcf7-9a31-45fa-a950-f8c423ddc547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:00.057205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb88-a483-497e-a4e1-97a0698117fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=944736323c6d481e999b8dab361b320b, user_id=84bfec29a8d34425a94bc661895b42f4, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:00.068043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5fb88-a483-497e-a4e1-97a0698117fc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:00.075441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157dcf7-9a31-45fa-a950-f8c423ddc547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:00.077325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157dcf7-9a31-45fa-a950-f8c423ddc547 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:00.094399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 702/1421] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:00.096960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059a14-5308-4de5-8e70-28324c904d99 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:00.096960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059a14-5308-4de5-8e70-28324c904d99 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:00.097482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059a14-5308-4de5-8e70-28324c904d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:00.125494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-34059a14-5308-4de5-8e70-28324c904d99 None None] MFA Rules not processed for user `1201fb5f14154b048f5c55bd566e91b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:00.126652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-34059a14-5308-4de5-8e70-28324c904d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:00.197938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 720/1422] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:07:59 2022] PUT /identity/v3/projects/944736323c6d481e999b8dab361b320b/users/84bfec29a8d34425a94bc661895b42f4/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:00.200955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:00.201402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:00.201781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:00.345820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 703/1423] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:00.358572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] MFA Rules not processed for user `84bfec29a8d34425a94bc661895b42f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:00.363748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:00.525001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7695-f946-4705-868d-380af51f666b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:00.525420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7695-f946-4705-868d-380af51f666b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:00.525747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7695-f946-4705-868d-380af51f666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:00.634860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 721/1424] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:00.642851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:00.648498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-62cd7695-f946-4705-868d-380af51f666b None None] MFA Rules not processed for user `4553b7573ca34af6a9fdb94f80717f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:00.649320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-62cd7695-f946-4705-868d-380af51f666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:00.989323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 704/1425] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:01.005910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01420307-a38c-478f-96fd-dc1221cd237d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:01.012127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:01.013951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.014519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.015051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.016726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:01.018983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:01.120432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21ee2-6b85-403b-9dc2-a7ed6b7ef086 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.125847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21ee2-6b85-403b-9dc2-a7ed6b7ef086 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.126367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21ee2-6b85-403b-9dc2-a7ed6b7ef086 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.129056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 705/1426] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:08:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:08:01.164213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.164972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.165649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.230852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 722/1427] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:00 2022] POST /identity/v3/projects => generated 369 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:01.235067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:01.240573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:01.244642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:01.465384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275f446-d300-4fef-be7f-2b3cc3ad5dfd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:01.476765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:01.478902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 706/1428] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:08:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:01.479009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.479009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.479009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.479009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:01.479266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:01.482519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:01.504976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:01.527845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:01.533703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d557d-96e8-442f-af34-e8f1a6e28226 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:01.550419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:01.551200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.552867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.553176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] PATH_INFO: `/v3/projects/7444de5a54c244f6956ff269f5f9abda` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.555702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7444de5a54c244f6956ff269f5f9abda)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:01.559171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:01.646560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 723/1429] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:01 2022] POST /identity/v3/users => generated 291 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:01.649261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:01.691055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba415f4-be22-4309-9404-a07f86df763b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:01.703533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:01.705312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.706486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.708042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.710165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:01.722502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:01.753802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 724/1430] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:01.755717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:01.755978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7444de5a54c244f6956ff269f5f9abda', 'request_id': 'req-ff9aef73-ea22-480b-8552-088ea7a47b3a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:01.775666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7444de5a54c244f6956ff269f5f9abda', 'request_id': 'req-ff9aef73-ea22-480b-8552-088ea7a47b3a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:01.779413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a8b9-d232-4f4f-b8ec-2cc0c36aeecf admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:01.789637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7444de5a54c244f6956ff269f5f9abda', 'request_id': 'req-ff9aef73-ea22-480b-8552-088ea7a47b3a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:01.924115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:01.924923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:01.925718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:01.926191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] PATH_INFO: `/v3/projects/80c447af0e9d4432892e1f3fee522b62/users/c4bc177ad6e043058ed8651f2a324e90/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:01.962625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c447af0e9d4432892e1f3fee522b62, user_id=c4bc177ad6e043058ed8651f2a324e90, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:01.966293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:02.081773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] The token cache is being invalidate because project 7444de5a54c244f6956ff269f5f9abda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:02.082274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.085113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.087328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 707/1431] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:01 2022] DELETE /identity/v3/projects/7444de5a54c244f6956ff269f5f9abda => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:02.090997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:02.115396 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:02.135771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aef73-ea22-480b-8552-088ea7a47b3a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:02.142211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:02.143769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:02.154371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:02.154697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] PATH_INFO: `/v3/users/5eb69b328ccb4237a2424ccd4e0af528` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:02.158423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb69b328ccb4237a2424ccd4e0af528)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:02.172844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:02.216204 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:02.221199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 725/1432] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:01 2022] PUT /identity/v3/projects/80c447af0e9d4432892e1f3fee522b62/users/c4bc177ad6e043058ed8651f2a324e90/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:02.231939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:02.240421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:02.426782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6103f1-3dea-4bab-aaa4-c648f9a11b20 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:02.432827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:02.436919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:02.436919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:02.436919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:02.436919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:02.440146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:02.471462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 726/1433] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:02.477626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:02.495635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd573-bddb-4479-b1d4-29f77d57f2f2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:02.543661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911d49d-3fdd-41fb-b0e1-2d8f5e21ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:02.547831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d49d-3fdd-41fb-b0e1-2d8f5e21ddf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:02.552508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d49d-3fdd-41fb-b0e1-2d8f5e21ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:02.552508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911d49d-3fdd-41fb-b0e1-2d8f5e21ddf9 admin admin] PATH_INFO: `/v3/projects/80c447af0e9d4432892e1f3fee522b62/users/c4bc177ad6e043058ed8651f2a324e90/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:02.558549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911d49d-3fdd-41fb-b0e1-2d8f5e21ddf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c447af0e9d4432892e1f3fee522b62, user_id=c4bc177ad6e043058ed8651f2a324e90, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:02.562348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb69b328ccb4237a2424ccd4e0af528'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.568091 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911d49d-3fdd-41fb-b0e1-2d8f5e21ddf9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:02.580318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb69b328ccb4237a2424ccd4e0af528'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.584457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb69b328ccb4237a2424ccd4e0af528'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.614002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 727/1434] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:02 2022] PUT /identity/v3/projects/80c447af0e9d4432892e1f3fee522b62/users/c4bc177ad6e043058ed8651f2a324e90/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:02.626030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:02.626947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:02.628691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:02.701009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb69b328ccb4237a2424ccd4e0af528'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.736287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb69b328ccb4237a2424ccd4e0af528'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:02.754682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] MFA Rules not processed for user `c4bc177ad6e043058ed8651f2a324e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:02.756097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:02.763869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 708/1435] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:02 2022] DELETE /identity/v3/users/5eb69b328ccb4237a2424ccd4e0af528 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:03.023859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 728/1436] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:03.038094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:03.041113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:03.147229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55cf10-5467-4e02-a98a-875f736a24ef admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:03.168356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:03.175638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:03.175638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:03.175638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:03.181850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:03.183363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:03.218732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 709/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:03.443184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:03.469686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbaac4-50d8-4ae0-9567-8c6adb58ca58 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:03.489210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:03.494182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:03.494677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:03.495115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:03.511412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:03.528718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:03.531863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:03.848073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:03.853768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:03.883048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 729/1438] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:03.892182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb2293-25c3-4cdc-ad07-6eea63ab2c37 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:03.921253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:03.922165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:03.922604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:03.923031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:03.929291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:03.950337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:03.954409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad714d8-48c8-41ea-a8e1-92d5995a7ef4 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:03.978404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 710/1439] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:04.056035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:04.059104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:04.180249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:04.511366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268c4b6-3b37-45f6-b2c3-3b332fbe3175 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:04.511366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:04.511366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:04.511366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:04.512679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] PATH_INFO: `/v3/users/5fcd9dfded9b4f6f8110165a678e896f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:04.512679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fcd9dfded9b4f6f8110165a678e896f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:04.512679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:04.867726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fcd9dfded9b4f6f8110165a678e896f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:04.867726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fcd9dfded9b4f6f8110165a678e896f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:04.903794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fcd9dfded9b4f6f8110165a678e896f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:04.907039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fcd9dfded9b4f6f8110165a678e896f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:05.006412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fcd9dfded9b4f6f8110165a678e896f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:05.021828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 730/1440] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:04 2022] DELETE /identity/v3/users/5fcd9dfded9b4f6f8110165a678e896f => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:05.025525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:05.026110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:05.026110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:05.064856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:05.286301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:05.286301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:05.315508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 711/1441] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:05.451231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:05.453019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:05.655159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a756050-c251-424e-80b6-ce27415c1854 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:05.676755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1578aa9-0ea2-45f9-a1d4-fc1c49499e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:05.678963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1578aa9-0ea2-45f9-a1d4-fc1c49499e1c service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:05.679397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1578aa9-0ea2-45f9-a1d4-fc1c49499e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:05.680339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1578aa9-0ea2-45f9-a1d4-fc1c49499e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:05.709205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1578aa9-0ea2-45f9-a1d4-fc1c49499e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:05.713658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1578aa9-0ea2-45f9-a1d4-fc1c49499e1c service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:05.742410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 731/1442] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:06.210254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:06.213103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:06.233966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554530b3-9542-4372-bf4b-23937c2d9c49 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:06.245915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:06.247065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:06.247882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:06.248131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] PATH_INFO: `/v3/projects/f4a05c24e45f427b834f94cb0c3dcfd5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:06.250322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a05c24e45f427b834f94cb0c3dcfd5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:06.252871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:06.444323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a05c24e45f427b834f94cb0c3dcfd5', 'request_id': 'req-668d70b0-b6f6-42cf-8364-063d7af5c548'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:06.470477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a05c24e45f427b834f94cb0c3dcfd5', 'request_id': 'req-668d70b0-b6f6-42cf-8364-063d7af5c548'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:06.491549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a05c24e45f427b834f94cb0c3dcfd5', 'request_id': 'req-668d70b0-b6f6-42cf-8364-063d7af5c548'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:06.621629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] The token cache is being invalidate because project f4a05c24e45f427b834f94cb0c3dcfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:06.622807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:06.622807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-668d70b0-b6f6-42cf-8364-063d7af5c548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:06.625013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 712/1443] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:06 2022] DELETE /identity/v3/projects/f4a05c24e45f427b834f94cb0c3dcfd5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:06.630576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:06.630576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:06.630817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:06.690895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:06.700073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:06.869651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 732/1444] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:06.877698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:06.878206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:06.879153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:06.953194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:06.966004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:06.998683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 713/1445] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:07.003227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:07.016128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1fca1-ebbe-4bfb-9882-d09b19447139 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:07.043853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:07.044746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:07.045220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:07.045592 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:07.046361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:07.046769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:07.058004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:07.104577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 733/1446] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:07.108873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:07.121577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86492bea-f365-4d5e-810d-71236c53dc9e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:07.134029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:07.136060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:07.140569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:07.141345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:07.142461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:07.147320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:07.421077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 714/1447] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:07 2022] POST /identity/v3/projects => generated 393 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:07.425884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:07.448065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16768fb2-376e-449b-9ef5-4223e8550a15 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:07.556892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:07.558961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:07.559348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:07.559782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:07.560466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:07.566208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:07.863536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 734/1448] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:07 2022] POST /identity/v3/users => generated 297 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:07.864502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:07.896732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6da72f-ff6c-4289-96d5-d602c76ee759 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:07.912153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:07.912370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:07.912790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:07.913289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:07.914318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:07.916816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:07.936270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 715/1449] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:07.937619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:07.956375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a14e3-8960-48d7-84b3-6828a88d9144 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:07.980714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d614a-295c-421c-aa6a-2c0f423cf040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:07.984895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d614a-295c-421c-aa6a-2c0f423cf040 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:07.985366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d614a-295c-421c-aa6a-2c0f423cf040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:07.986001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d614a-295c-421c-aa6a-2c0f423cf040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:07.987031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d614a-295c-421c-aa6a-2c0f423cf040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:07.990954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d614a-295c-421c-aa6a-2c0f423cf040 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:08.007552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 735/1450] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:08.010937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:08.041716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd98a0-492d-4e8e-8452-5690f683c95c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:08.050907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:08.180274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:08.180274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:08.180274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] PATH_INFO: `/v3/projects/63446ef52dfb45dca9b26136af3587be/users/e43eee69af9645d19487879e15193ee0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:08.180274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63446ef52dfb45dca9b26136af3587be, user_id=e43eee69af9645d19487879e15193ee0, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:08.180274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:08.311451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 716/1451] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:08 2022] PUT /identity/v3/projects/63446ef52dfb45dca9b26136af3587be/users/e43eee69af9645d19487879e15193ee0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:08.313087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:08.313386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:08.313667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:08.397115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:08.399153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:08.428627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:08.429877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] MFA Rules not processed for user `e43eee69af9645d19487879e15193ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:08.437979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:08.581421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959118-dbb5-43b2-bc6c-b8d84e86fb4f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:08.594191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:08.595110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:08.595786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:08.596281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] PATH_INFO: `/v3/projects/775de2e52eac4e96b4d7ba14dde4edfc` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:08.603732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=775de2e52eac4e96b4d7ba14dde4edfc)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:08.617064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:08.717731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 736/1452] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:08.723634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:08.805817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616fc20-aa7b-432e-9675-1ce59eccdb06 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:08.848795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775de2e52eac4e96b4d7ba14dde4edfc', 'request_id': 'req-80e5667c-43b2-4802-aec8-ffac1929dc5d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:08.899447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:08.899850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775de2e52eac4e96b4d7ba14dde4edfc', 'request_id': 'req-80e5667c-43b2-4802-aec8-ffac1929dc5d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:08.899850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775de2e52eac4e96b4d7ba14dde4edfc', 'request_id': 'req-80e5667c-43b2-4802-aec8-ffac1929dc5d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:08.997532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:08.998586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:08.998961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:08.999271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:08.999986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:09.002251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:09.118599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] The token cache is being invalidate because project 775de2e52eac4e96b4d7ba14dde4edfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:09.118971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:09.134871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:09.141148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 717/1453] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:08 2022] DELETE /identity/v3/projects/775de2e52eac4e96b4d7ba14dde4edfc => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:09.145043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:09.150064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:09.172946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 737/1454] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:08 2022] POST /identity/v3/projects => generated 393 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:09.181360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:09.184547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:09.211427 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5667c-43b2-4802-aec8-ffac1929dc5d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:09.420316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdf8d-8960-4f57-b402-98117f59866b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:09.426315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:09.427536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:09.428251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:09.428907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:09.429169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:09.429635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:09.429725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:09.429725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] PATH_INFO: `/v3/users/e39cd26f4d94497d99972dcf99143794` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:09.429981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:09.432148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:09.437273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39cd26f4d94497d99972dcf99143794)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:09.446833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:09.537337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 738/1455] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:09 2022] POST /identity/v3/users => generated 303 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:09.542870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:09.566211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f64e8-7199-4027-bcf9-350f4f5e09ea admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:09.573236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:09.574108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:09.574564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:09.574990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:09.575910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:09.577979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:09.786000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 739/1456] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:09.790639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:09.803512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7ea4d-6eed-4547-8e73-c51e321f7583 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:09.829880 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:09.831591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:09.831875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:09.832153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] PATH_INFO: `/v3/projects/fe85575f37c94c23a0712e35201b657c/users/9a153b620c7f4beaa2c30b9522fb8eae/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:09.849412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe85575f37c94c23a0712e35201b657c, user_id=9a153b620c7f4beaa2c30b9522fb8eae, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:09.852602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:10.054083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 740/1457] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:09 2022] PUT /identity/v3/projects/fe85575f37c94c23a0712e35201b657c/users/9a153b620c7f4beaa2c30b9522fb8eae/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:10.058229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:10.079743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39cd26f4d94497d99972dcf99143794'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:10.101772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39cd26f4d94497d99972dcf99143794'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:10.106942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39cd26f4d94497d99972dcf99143794'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:10.156706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85ca9f-59a8-4118-8afc-2f1ff6d743ea admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:10.163962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe804da-49a7-45f0-ad80-70b8a23ae3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:10.165426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe804da-49a7-45f0-ad80-70b8a23ae3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.165426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe804da-49a7-45f0-ad80-70b8a23ae3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.165640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe804da-49a7-45f0-ad80-70b8a23ae3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.166354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe804da-49a7-45f0-ad80-70b8a23ae3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:10.168624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe804da-49a7-45f0-ad80-70b8a23ae3fa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:10.195026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39cd26f4d94497d99972dcf99143794'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:10.196315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 741/1458] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:10.199770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257420c-4bd1-477f-b332-ce75f7a383aa None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.200358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257420c-4bd1-477f-b332-ce75f7a383aa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.200732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257420c-4bd1-477f-b332-ce75f7a383aa None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.202840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 742/1459] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:08:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:08:10.203908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257420c-4bd1-477f-b332-ce75f7a383aa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:10.207368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0257420c-4bd1-477f-b332-ce75f7a383aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:10.222899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ceb83bc0-81de-46d0-a7bf-bc692369cfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39cd26f4d94497d99972dcf99143794'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:10.234826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257420c-4bd1-477f-b332-ce75f7a383aa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:10.260840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcefcfc-bd67-4726-9b9b-5491e1d54943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:10.261745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcefcfc-bd67-4726-9b9b-5491e1d54943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.262198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcefcfc-bd67-4726-9b9b-5491e1d54943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.262654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcefcfc-bd67-4726-9b9b-5491e1d54943 admin admin] PATH_INFO: `/v3/projects/fe85575f37c94c23a0712e35201b657c/users/9a153b620c7f4beaa2c30b9522fb8eae/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.264588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 718/1460] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:09 2022] DELETE /identity/v3/users/e39cd26f4d94497d99972dcf99143794 => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:10.268274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.268590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.268945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.269644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcefcfc-bd67-4726-9b9b-5491e1d54943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe85575f37c94c23a0712e35201b657c, user_id=9a153b620c7f4beaa2c30b9522fb8eae, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:10.272572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcefcfc-bd67-4726-9b9b-5491e1d54943 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:10.299930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 743/1461] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:10 2022] PUT /identity/v3/projects/fe85575f37c94c23a0712e35201b657c/users/9a153b620c7f4beaa2c30b9522fb8eae/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:10.310237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:10.310237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:10.315063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.318986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.318986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.390197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] MFA Rules not processed for user `9a153b620c7f4beaa2c30b9522fb8eae`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:10.391590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:10.574524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 744/1462] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:10.576240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 719/1463] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:10.586726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:10.588814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:10.635682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:10.637523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:10.664869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0851505-e713-4abb-bc0b-90e6c8398d5e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:10.678740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:10.679582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.679867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.680142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.702754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:10.706298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:10.737639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 720/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:10.779808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273182fc-6db7-4a18-bd62-06d6f2b0feb2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:10.785353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:10.786230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.786673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.787012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.799346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:10.801438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:10.822218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 745/1465] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:10.910078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:10.917207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438061c-0cfa-421f-9b53-4a71b464bed8 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:10.922300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:10.923207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:10.923647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:10.924313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:10.927197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:11.003264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:11.004143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd378c-4488-4042-accc-02a911d02e25 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:11.014145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 721/1466] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:11.756610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:11.758442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:11.842487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b85a9f-1a1f-4c3f-b47e-e3c7bddf52cc service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:11.849562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:11.850202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:11.850478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:11.850750 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] PATH_INFO: `/v3/projects/98dcd2fba50b467f9c04958ffcf070df` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:11.852072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98dcd2fba50b467f9c04958ffcf070df)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:11.854104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.026202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dcd2fba50b467f9c04958ffcf070df', 'request_id': 'req-7d047f8f-bb15-4ae6-94a8-de5d397b1015'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.035797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dcd2fba50b467f9c04958ffcf070df', 'request_id': 'req-7d047f8f-bb15-4ae6-94a8-de5d397b1015'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.156778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dcd2fba50b467f9c04958ffcf070df', 'request_id': 'req-7d047f8f-bb15-4ae6-94a8-de5d397b1015'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.171553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] The token cache is being invalidate because project 98dcd2fba50b467f9c04958ffcf070df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:12.171846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.172543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.174321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 746/1467] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:11 2022] DELETE /identity/v3/projects/98dcd2fba50b467f9c04958ffcf070df => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:12.180119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f5fc-24e9-4ea2-b817-7a838c075184 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.180662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f5fc-24e9-4ea2-b817-7a838c075184 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.180878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5f5fc-24e9-4ea2-b817-7a838c075184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.185415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.187342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:12.207415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ceb5f5fc-24e9-4ea2-b817-7a838c075184 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:12.208914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ceb5f5fc-24e9-4ea2-b817-7a838c075184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:12.267338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:12.272674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047f8f-bb15-4ae6-94a8-de5d397b1015 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.278413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.278808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.279282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.279445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] PATH_INFO: `/v3/users/84bfec29a8d34425a94bc661895b42f4` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.280865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84bfec29a8d34425a94bc661895b42f4)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.282899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.299410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 722/1468] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:12.302273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.302568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.302845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.322437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:12.323633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:12.331470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 723/1469] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:12.335900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.344956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e4f48-9e2c-4b3d-aa87-632fb746ca86 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.350308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.350810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.351063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.351348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.352035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:12.352338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.353968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.371399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 724/1470] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:08:12.372960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.385539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3345d-0de6-41cd-ab3b-67abdd386b9a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.391444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.392078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.392367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.392682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.393332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.395382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.492368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 725/1471] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:12 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:12.496464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.510162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84bfec29a8d34425a94bc661895b42f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.529393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84bfec29a8d34425a94bc661895b42f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.547561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84bfec29a8d34425a94bc661895b42f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.548653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84bfec29a8d34425a94bc661895b42f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.603882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1132b2-6b9a-451a-9ea0-14fe902c5f9f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.611161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.611161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.611161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.611161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.611552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.612857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.631500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7c6f3151-d3cb-4d37-93fe-97ef0efa12d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84bfec29a8d34425a94bc661895b42f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:12.640070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 747/1472] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:12 2022] DELETE /identity/v3/users/84bfec29a8d34425a94bc661895b42f4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:12.659079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.660145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.660621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.694838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:12.697376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:12.723794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 726/1473] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:12 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:12.727918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.735238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:12.750733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49260a03-d42d-47a2-b559-72c7ac346d9c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.778522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 748/1474] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:12.820130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.824042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:12.830895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.832915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.833535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.833883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.835443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.839904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.857706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 727/1475] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:12.861856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.886324 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fbba1-db44-4d1b-991d-26ec6dec063c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.897894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.898894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.898894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.903896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.903896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.903896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:12.920318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 728/1476] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:12.925217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:12.945728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7786c-d5f8-4274-bbd4-a07104af8745 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:12.951156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:12.951929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:12.952264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:12.952588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] PATH_INFO: `/v3/projects/e477f94a2e1a49e2b247455dac9cd1b0/users/9de956e0b7ea427f93d7e652095459a2/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:12.977044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e477f94a2e1a49e2b247455dac9cd1b0, user_id=9de956e0b7ea427f93d7e652095459a2, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:12.993586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.003677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c242e-0a66-491b-b9d6-0f51ffcd6d31 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.006080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6323a5f-5f0a-468e-a048-516c365527ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.006969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323a5f-5f0a-468e-a048-516c365527ed service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.007506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323a5f-5f0a-468e-a048-516c365527ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.008085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6323a5f-5f0a-468e-a048-516c365527ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.021034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6323a5f-5f0a-468e-a048-516c365527ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.023544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6323a5f-5f0a-468e-a048-516c365527ed service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.052861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 749/1477] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:13.088107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 729/1478] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:12 2022] PUT /identity/v3/projects/e477f94a2e1a49e2b247455dac9cd1b0/users/9de956e0b7ea427f93d7e652095459a2/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:13.098252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.098680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.099061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.139273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] MFA Rules not processed for user `9de956e0b7ea427f93d7e652095459a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:13.141325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:13.163083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:13.293718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 750/1479] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:13.298250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:13.368804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7879d0-7e44-45b7-98ec-ee3910d3274b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.373821 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.374581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.374978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.375343 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.376755 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.381268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.506226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:13.506574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 730/1480] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:13 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:13.522954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806edec-73d9-4a94-95d2-017b235a2075 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.609759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.609759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.609759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.609759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.610506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.612698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.728605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 751/1481] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:13 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:13.732419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:13.742660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593b0dc-45d0-401c-947b-9488e48637a2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.747374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.751414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.751414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.751414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.751414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.751414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.763035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 731/1482] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:13.767737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:13.778756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00db7-7926-484d-ac1f-209fd81b8f09 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.787785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.787785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.787785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.787785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.788165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.788613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.803380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 752/1483] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:13.804217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:13.816001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feb6a7-1658-4d07-b8a8-4215980b71db admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.825540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f65ce-e46d-4fdc-abb5-df91432ab314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.828330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f65ce-e46d-4fdc-abb5-df91432ab314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.828330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f65ce-e46d-4fdc-abb5-df91432ab314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.828330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f65ce-e46d-4fdc-abb5-df91432ab314 admin admin] PATH_INFO: `/v3/projects/06674f115430492f8f7a6d2c858069bf/users/5509185fa66b402cb97fec6939f31aa3/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.856698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f65ce-e46d-4fdc-abb5-df91432ab314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06674f115430492f8f7a6d2c858069bf, user_id=5509185fa66b402cb97fec6939f31aa3, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.859907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f65ce-e46d-4fdc-abb5-df91432ab314 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.962588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:13.965129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:13.980225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6f9e-7349-4957-a26b-74c2a81223a3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:13.986473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:13.987275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:13.987652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:13.988131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] PATH_INFO: `/v3/projects/944736323c6d481e999b8dab361b320b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:13.989708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944736323c6d481e999b8dab361b320b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:13.994762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:13.994873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 732/1484] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:13 2022] PUT /identity/v3/projects/06674f115430492f8f7a6d2c858069bf/users/5509185fa66b402cb97fec6939f31aa3/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:14.005248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:14.005541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:14.005813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:14.089486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] MFA Rules not processed for user `5509185fa66b402cb97fec6939f31aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:14.092861 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:14.186675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944736323c6d481e999b8dab361b320b', 'request_id': 'req-3626cf64-849b-412b-a295-64125020f9b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.204035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944736323c6d481e999b8dab361b320b', 'request_id': 'req-3626cf64-849b-412b-a295-64125020f9b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.224080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 733/1485] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:14.228661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:14.285151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944736323c6d481e999b8dab361b320b', 'request_id': 'req-3626cf64-849b-412b-a295-64125020f9b7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.321599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] The token cache is being invalidate because project 944736323c6d481e999b8dab361b320b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:14.327682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.327682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.327682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 753/1486] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:13 2022] DELETE /identity/v3/projects/944736323c6d481e999b8dab361b320b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:14.343807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:14.352673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:14.372027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932734e-ec21-44d6-b01a-ddba5210855b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:14.400137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:14.451810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:14.452664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:14.452948 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:14.453229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:14.453875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:14.456046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:14.465246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626cf64-849b-412b-a295-64125020f9b7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:14.469760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:14.470569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:14.471541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:14.471957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] PATH_INFO: `/v3/users/c4bc177ad6e043058ed8651f2a324e90` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:14.474389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4bc177ad6e043058ed8651f2a324e90)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:14.477006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:14.593057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 734/1487] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:14 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:14.597711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:14.599662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:14.670643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2038-ac2f-4382-b404-9448132c90a8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:14.675320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:14.675939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:14.676219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:14.676527 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:14.677169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:14.679104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:14.697646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4bc177ad6e043058ed8651f2a324e90'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.704496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4bc177ad6e043058ed8651f2a324e90'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.717179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4bc177ad6e043058ed8651f2a324e90'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.717901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4bc177ad6e043058ed8651f2a324e90'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.774745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 735/1488] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:14 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:14.778784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:14.780402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:14.791246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4bc177ad6e043058ed8651f2a324e90'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:14.792493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb542c9d-bc27-42b2-8af1-ebfd32a81eef admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:14.797778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:14.805902 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 754/1489] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:14 2022] DELETE /identity/v3/users/c4bc177ad6e043058ed8651f2a324e90 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:14.806032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:14.806032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:14.806032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:14.806032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:14.806032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:14.813230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 736/1490] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:14.818189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:14.886428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ded96-0b55-4082-8786-77d59331ed89 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:14.891996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:14.892695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:14.893486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:14.893829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] PATH_INFO: `/v3/projects/f22b9d67740544979dd944793875754a/users/5d28f70c7be341b1bb27420473090cd6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:14.909809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22b9d67740544979dd944793875754a, user_id=5d28f70c7be341b1bb27420473090cd6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:14.912642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:15.031317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 755/1491] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:14 2022] PUT /identity/v3/projects/f22b9d67740544979dd944793875754a/users/5d28f70c7be341b1bb27420473090cd6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:15.035247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:15.045970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29991d9-c227-4c3f-9cf8-8eca3f7f21a4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:15.107193 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7443a-1f9f-435a-8c85-7dae8761b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:15.107809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7443a-1f9f-435a-8c85-7dae8761b48c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.108087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7443a-1f9f-435a-8c85-7dae8761b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.108358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7443a-1f9f-435a-8c85-7dae8761b48c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.109033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7443a-1f9f-435a-8c85-7dae8761b48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:15.110662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7443a-1f9f-435a-8c85-7dae8761b48c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:15.121699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 737/1492] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:15.126258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:15.137924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306a10-691c-41b9-84d5-1db7896cfdce admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:15.143595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:15.144269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.144577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.144845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] PATH_INFO: `/v3/projects/f22b9d67740544979dd944793875754a/users/5d28f70c7be341b1bb27420473090cd6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.150493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22b9d67740544979dd944793875754a, user_id=5d28f70c7be341b1bb27420473090cd6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:15.150493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:15.161486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 756/1493] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:15 2022] PUT /identity/v3/projects/f22b9d67740544979dd944793875754a/users/5d28f70c7be341b1bb27420473090cd6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:15.179424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.179573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.179743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.221043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] MFA Rules not processed for user `5d28f70c7be341b1bb27420473090cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:15.223027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:15.326006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 738/1494] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:15.338107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:15.340424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:15.419104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd35ee-cfb8-46a3-9637-1527780cca6e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:15.422809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce52a6-7824-43bd-8385-7a21da9e0b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:15.423531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce52a6-7824-43bd-8385-7a21da9e0b7c service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.424120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce52a6-7824-43bd-8385-7a21da9e0b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.424406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce52a6-7824-43bd-8385-7a21da9e0b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.433225 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:15.435093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce52a6-7824-43bd-8385-7a21da9e0b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:15.436611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:15.436710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce52a6-7824-43bd-8385-7a21da9e0b7c service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:15.451593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 757/1495] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:15.549756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba93b8-e8e5-49cf-a5c5-71e8a02bd5a7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:15.554619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:15.556618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.557083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.557521 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] PATH_INFO: `/v3/projects/80c447af0e9d4432892e1f3fee522b62` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.558767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c447af0e9d4432892e1f3fee522b62)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:15.560788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:15.640671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:15.714565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c447af0e9d4432892e1f3fee522b62', 'request_id': 'req-3327b170-3446-4d61-a86b-3c0e3e33482a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:15.726573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c447af0e9d4432892e1f3fee522b62', 'request_id': 'req-3327b170-3446-4d61-a86b-3c0e3e33482a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:15.738066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c447af0e9d4432892e1f3fee522b62', 'request_id': 'req-3327b170-3446-4d61-a86b-3c0e3e33482a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:15.762622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:15.840366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] The token cache is being invalidate because project 80c447af0e9d4432892e1f3fee522b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:15.844332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:15.844332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3327b170-3446-4d61-a86b-3c0e3e33482a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:15.844332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 739/1496] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:15 2022] DELETE /identity/v3/projects/80c447af0e9d4432892e1f3fee522b62 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:15.849270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.850260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.850545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.872171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:15.873717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:15.933585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 758/1497] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:15.943832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:15.944754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:15.944754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:15.988809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:15.992546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:16.016982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 740/1498] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:16.021714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.034473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea383bb-4e05-469e-a195-4c5384be5cc7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.043633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.044652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.046681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.047067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.047971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:16.048569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.050430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.079337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 759/1499] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:16.096432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.103071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb849921-785c-4e93-8775-2ae6968b36ce None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.109226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.110263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.110538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.110798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.111436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.113931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.218488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 741/1500] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:16 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:16.222660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.232769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86932c-ed23-4211-8494-9dc268006e53 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.290565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.291369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.292974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.292974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.292974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.294727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.410554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 760/1501] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:16 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:16.415227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.427279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a4923-5531-43a4-b244-f85547dae119 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.433486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.434873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.435684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.436196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.437130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.439060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.451511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 742/1502] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:16.456175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.468101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec348bb8-d91a-49d2-94ab-ce1940831a29 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.490895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eb49a-de46-485c-af1f-16ae851a43c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.491773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb49a-de46-485c-af1f-16ae851a43c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.492144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb49a-de46-485c-af1f-16ae851a43c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.492459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb49a-de46-485c-af1f-16ae851a43c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.493121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eb49a-de46-485c-af1f-16ae851a43c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.494756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eb49a-de46-485c-af1f-16ae851a43c2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.506287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 761/1503] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:16.510534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.521190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923518-b9fe-4655-9336-c40cccb36fa2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.526266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.527123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.527409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.527686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] PATH_INFO: `/v3/projects/c320269d0c5b4e9195aa4f52a7650b8f/users/762a5f04cbe24841b63eb9cda7203adf/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.542715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c320269d0c5b4e9195aa4f52a7650b8f, user_id=762a5f04cbe24841b63eb9cda7203adf, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.545524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.620062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 743/1504] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:16 2022] PUT /identity/v3/projects/c320269d0c5b4e9195aa4f52a7650b8f/users/762a5f04cbe24841b63eb9cda7203adf/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:16.637470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.637822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.638025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.694086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] MFA Rules not processed for user `762a5f04cbe24841b63eb9cda7203adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:16.700945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:16.743891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.745716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:16.833931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 762/1505] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:16.835391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:16.836876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:16.867114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5cbe6-04ff-4245-872f-0ded3edce1dd admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.873759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.875243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.875607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.875887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] PATH_INFO: `/v3/users/e43eee69af9645d19487879e15193ee0` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.877120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43eee69af9645d19487879e15193ee0)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.881437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:16.910744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bd791-4c19-4daa-8dd3-6a6c6b5a4a8d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:16.916723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:16.917749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:16.918208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:16.925598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:16.925598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:16.995696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:16.997527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.008052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 763/1506] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:17.008732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.031416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd03c0-0112-4435-b5dc-4095501e59f8 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.031416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.031416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.031416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.031745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.031745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.031745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.154639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 764/1507] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:17 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:17.160210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.187892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43eee69af9645d19487879e15193ee0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:17.203535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43eee69af9645d19487879e15193ee0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:17.204512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43eee69af9645d19487879e15193ee0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:17.264195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce70ba-4b31-4497-aaaf-4537811e4986 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.264195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.264195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.264195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.264846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.264846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.264846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.283250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43eee69af9645d19487879e15193ee0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:17.307277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-fee8fd02-5cfd-461d-a55c-500095fe1f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43eee69af9645d19487879e15193ee0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:17.318578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 744/1508] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:16 2022] DELETE /identity/v3/users/e43eee69af9645d19487879e15193ee0 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:17.324145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.324878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.325360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.378753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 765/1509] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:17 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:17.382772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:17.382772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:17.398711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.402883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:17.424046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13d71-0284-4276-a082-866a61eca670 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.464737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:17.495350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 745/1510] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:17.505837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.508122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.508122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.508122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.508122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.509849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.528061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 766/1511] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:17.539514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.541867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.545626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:17.578652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f8438-3840-4990-9278-1184011fa60b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.593710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.595007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.595376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.595652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] PATH_INFO: `/v3/projects/3631ea3cf3fa4177ba8fe4cb9e227d9b/users/e1025d14eb514641bb2407f8ffe6ccb6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.621270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3631ea3cf3fa4177ba8fe4cb9e227d9b, user_id=e1025d14eb514641bb2407f8ffe6ccb6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.626987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.678765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145eb8a-1b02-48bf-8d33-58359f163003 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.694079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.695052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.695052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.695363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.716755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.718233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.735587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 767/1512] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:17.737417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 746/1513] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:17 2022] PUT /identity/v3/projects/3631ea3cf3fa4177ba8fe4cb9e227d9b/users/e1025d14eb514641bb2407f8ffe6ccb6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:17.742140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.762159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e7c14-d069-441d-9a61-f5b966032073 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.868428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcb8fa-15e6-4283-86dc-2d155bba69be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.869245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcb8fa-15e6-4283-86dc-2d155bba69be admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.869424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcb8fa-15e6-4283-86dc-2d155bba69be admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.870018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcb8fa-15e6-4283-86dc-2d155bba69be admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.872417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcb8fa-15e6-4283-86dc-2d155bba69be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.879252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcb8fa-15e6-4283-86dc-2d155bba69be admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.902115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:17.912434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 768/1514] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:17.919409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a9e0a-78fe-4910-84b5-469ac831c891 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:17.945622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:17.946451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.946734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.947000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] PATH_INFO: `/v3/projects/3631ea3cf3fa4177ba8fe4cb9e227d9b/users/e1025d14eb514641bb2407f8ffe6ccb6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:17.950435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3631ea3cf3fa4177ba8fe4cb9e227d9b, user_id=e1025d14eb514641bb2407f8ffe6ccb6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:17.954777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:17.971250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 747/1515] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:17 2022] PUT /identity/v3/projects/3631ea3cf3fa4177ba8fe4cb9e227d9b/users/e1025d14eb514641bb2407f8ffe6ccb6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:17.985711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c377-495f-4d20-bd17-144c4a6d8152 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:17.985998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c377-495f-4d20-bd17-144c4a6d8152 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:17.986279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c377-495f-4d20-bd17-144c4a6d8152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:18.029509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-89e5c377-495f-4d20-bd17-144c4a6d8152 None None] MFA Rules not processed for user `e1025d14eb514641bb2407f8ffe6ccb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:18.030490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-89e5c377-495f-4d20-bd17-144c4a6d8152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:18.163103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 769/1516] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:18.171014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:18.171934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:18.257386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38f661-adcc-4b4c-b00f-b35b754fce5c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:18.262007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6159d4a-3d14-4583-bc69-8cea90cd475f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:18.262795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159d4a-3d14-4583-bc69-8cea90cd475f service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:18.263172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159d4a-3d14-4583-bc69-8cea90cd475f service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:18.263596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6159d4a-3d14-4583-bc69-8cea90cd475f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:18.276736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159d4a-3d14-4583-bc69-8cea90cd475f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:18.278358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6159d4a-3d14-4583-bc69-8cea90cd475f service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:18.305665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 748/1517] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:18.362598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3694f1-5101-4672-86f5-9f89f3eec02d None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:18.362598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3694f1-5101-4672-86f5-9f89f3eec02d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:18.362598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3694f1-5101-4672-86f5-9f89f3eec02d None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:18.363810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 770/1518] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:08:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:08:18.390493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:18.390493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:18.390493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:18.443218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:18.444950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:18.446209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:18.590509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3694f1-5101-4672-86f5-9f89f3eec02d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:18.590750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 749/1519] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:08:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:18.608916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3694f1-5101-4672-86f5-9f89f3eec02d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:18.615159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:18.617005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:18.617500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:18.618022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:18.621207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:18.679470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:18.681292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:18.710271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ba66-4952-4307-93cb-0c5445bfa979 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:18.716415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:18.717062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:18.717334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:18.717608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:18.729154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:18.731105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:18.732577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:18.739713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:18.743894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 750/1520] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:18.759482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 771/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:18.909401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:18.911418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:19.022162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d519b52-5cf7-4aef-aece-ee87793c671e service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:19.028272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:19.028966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:19.029246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:19.029519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] PATH_INFO: `/v3/projects/63446ef52dfb45dca9b26136af3587be` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:19.030653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63446ef52dfb45dca9b26136af3587be)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:19.032881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:19.241232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63446ef52dfb45dca9b26136af3587be', 'request_id': 'req-e898aecf-0eb2-4116-8841-16e113dc6d81'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.248837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63446ef52dfb45dca9b26136af3587be', 'request_id': 'req-e898aecf-0eb2-4116-8841-16e113dc6d81'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.258061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63446ef52dfb45dca9b26136af3587be', 'request_id': 'req-e898aecf-0eb2-4116-8841-16e113dc6d81'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.324592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] The token cache is being invalidate because project 63446ef52dfb45dca9b26136af3587be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:19.324592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.324592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.324592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 751/1522] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:18 2022] DELETE /identity/v3/projects/63446ef52dfb45dca9b26136af3587be => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:19.327363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:19.344590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc055b25-5b93-4bcb-adb5-922205cb6ced service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:19.458941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:19.459590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:19.459866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:19.460139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] PATH_INFO: `/v3/users/9a153b620c7f4beaa2c30b9522fb8eae` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:19.461325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a153b620c7f4beaa2c30b9522fb8eae)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:19.463375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:19.716249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a153b620c7f4beaa2c30b9522fb8eae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.738344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a153b620c7f4beaa2c30b9522fb8eae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.772795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a153b620c7f4beaa2c30b9522fb8eae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.778250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:19.778491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a153b620c7f4beaa2c30b9522fb8eae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.900423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e2377fd7-8fa8-4499-bf31-3e483f3ab8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a153b620c7f4beaa2c30b9522fb8eae'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:19.911340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 772/1523] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:19 2022] DELETE /identity/v3/users/9a153b620c7f4beaa2c30b9522fb8eae => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:20.486661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:20.488748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:20.509007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898aecf-0eb2-4116-8841-16e113dc6d81 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:20.572556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:20.573221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:20.573514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:20.573798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] PATH_INFO: `/v3/projects/fe85575f37c94c23a0712e35201b657c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:20.575018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe85575f37c94c23a0712e35201b657c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:20.576994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:20.711486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe85575f37c94c23a0712e35201b657c', 'request_id': 'req-9891bcdb-f16f-4627-aafb-f9154dc9b105'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:20.717506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe85575f37c94c23a0712e35201b657c', 'request_id': 'req-9891bcdb-f16f-4627-aafb-f9154dc9b105'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:20.725770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe85575f37c94c23a0712e35201b657c', 'request_id': 'req-9891bcdb-f16f-4627-aafb-f9154dc9b105'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:20.822360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] The token cache is being invalidate because project fe85575f37c94c23a0712e35201b657c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:20.822663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:20.823315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9891bcdb-f16f-4627-aafb-f9154dc9b105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:20.827691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 752/1524] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:20 2022] DELETE /identity/v3/projects/fe85575f37c94c23a0712e35201b657c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:20.829906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:20.830349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:20.831000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:20.851670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:20.852915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:20.914713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 773/1525] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:20.922683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:20.923000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:20.923305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:20.944326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:20.945589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:20.953694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 753/1526] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:20.958831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:20.968475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0608a-0894-44d7-9be4-7d251b415ed9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:20.973741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:20.974579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:20.974579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:20.974855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:20.975532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:20.975838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:20.977469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:20.988891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 774/1527] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:20.997780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.008264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88b592-41f7-45b9-a2ea-e41fd2905fe8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:21.015399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:21.016024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.020875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.020875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.020875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:21.020875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:21.160781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 754/1528] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:20 2022] POST /identity/v3/projects => generated 409 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:21.162171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.176781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f833965-9921-4fed-8b6b-7ad097325e7f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:21.249430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:21.250742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.250742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.250742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.251512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:21.254400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:21.342715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 775/1529] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:21 2022] POST /identity/v3/users => generated 305 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:21.346914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.357177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69423d5e-8839-4872-b8bb-c36452553f2e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:21.361943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:21.362532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.362829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.363107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.363769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:21.365471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:21.375195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 755/1530] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:21.379703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.390385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa4721-3be3-4569-be2d-6b7aeab6ef26 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:21.396178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2801e-0e73-49fd-b786-d140b6bd1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:21.396848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2801e-0e73-49fd-b786-d140b6bd1044 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.397127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2801e-0e73-49fd-b786-d140b6bd1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.397398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2801e-0e73-49fd-b786-d140b6bd1044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.398086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2801e-0e73-49fd-b786-d140b6bd1044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:21.399668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2801e-0e73-49fd-b786-d140b6bd1044 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:21.411890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 776/1531] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:21.416114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.432712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665090-a94b-43f2-a75e-02f9d23886e7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:21.432712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:21.432712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.432712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.433086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] PATH_INFO: `/v3/projects/f4f4f0e43fca4e5e96d163989e874d3e/users/669ade692ce14da68f5f08469bd2a1dd/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.447772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f4f0e43fca4e5e96d163989e874d3e, user_id=669ade692ce14da68f5f08469bd2a1dd, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:21.450768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:21.527363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 756/1532] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:21 2022] PUT /identity/v3/projects/f4f4f0e43fca4e5e96d163989e874d3e/users/669ade692ce14da68f5f08469bd2a1dd/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:21.538240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.538786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.541185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.568550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] MFA Rules not processed for user `669ade692ce14da68f5f08469bd2a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:21.569937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:21.652997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 777/1533] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:21 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:21.654100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.722010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4abf-b72e-4310-be94-ed167342d5b3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:21.726611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:21.727217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:21.727495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:21.727763 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:21.728413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:21.730306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:21.768186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:21.867454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 757/1534] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:21 2022] POST /identity/v3/projects => generated 409 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:21.871537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:21.882761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee56f81-42ae-4998-94f1-e176b8c08678 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.066864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.067480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.067754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.068022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.068766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.070932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.169951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 778/1535] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:21 2022] POST /identity/v3/users => generated 311 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:22.175103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:22.185180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0264482-931e-4632-843c-24f280c525bb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.195146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.195940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.196334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.196633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.197385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.199018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.210217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 758/1536] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:22.214207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:22.225914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f38602-7bb6-47ab-b5a9-7ceb2f70e0fe admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.231755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.232454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.232740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.233021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] PATH_INFO: `/v3/projects/a8f86b5507fe43409bcfb96dfb958145/users/d4dc81283aa341ffbfd8b27b96474e75/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.250759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f86b5507fe43409bcfb96dfb958145, user_id=d4dc81283aa341ffbfd8b27b96474e75, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.254578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.371386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 779/1537] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:22 2022] PUT /identity/v3/projects/a8f86b5507fe43409bcfb96dfb958145/users/d4dc81283aa341ffbfd8b27b96474e75/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:22.372283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:22.386053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67959e-c17a-42ea-a1d1-9929e0b1c0d8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.488933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:22.491059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:22.514627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.515288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.515580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.515839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.516607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.519016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.533322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 759/1538] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:22.540721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:22.552800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96610a-bf88-4b9f-bd17-237d6411873a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.563272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c34248-c3c2-4d8a-b5cb-a648c1520d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.565243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c34248-c3c2-4d8a-b5cb-a648c1520d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.565698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c34248-c3c2-4d8a-b5cb-a648c1520d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.566109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c34248-c3c2-4d8a-b5cb-a648c1520d3e admin admin] PATH_INFO: `/v3/projects/a8f86b5507fe43409bcfb96dfb958145/users/d4dc81283aa341ffbfd8b27b96474e75/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.568547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c34248-c3c2-4d8a-b5cb-a648c1520d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f86b5507fe43409bcfb96dfb958145, user_id=d4dc81283aa341ffbfd8b27b96474e75, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.571653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c34248-c3c2-4d8a-b5cb-a648c1520d3e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.591326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 760/1539] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:22 2022] PUT /identity/v3/projects/a8f86b5507fe43409bcfb96dfb958145/users/d4dc81283aa341ffbfd8b27b96474e75/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:22.613236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.615311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.615825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.655664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab4ae-e1ce-45ce-a1c4-d8ff41e960f1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.674162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] MFA Rules not processed for user `d4dc81283aa341ffbfd8b27b96474e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:22.689583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:22.728649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.729404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.729725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.741074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.744288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:22.771789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:22.809044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 761/1540] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:22 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:22.831307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.833533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.850041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:22.850041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:22.858604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 780/1541] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:22.862509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c428a-e65f-4d0a-8580-08af32e1cde4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:22.868044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:22.868800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:22.869318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:22.870513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:22.884131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:22.886184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:22.901036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 762/1542] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:23.642375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:23.654422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784cc4-913c-4ab2-af7c-8c3cd78364b6 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:23.658323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:23.659478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:23.659739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:23.660008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:23.720633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:23.723113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:23.732966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 781/1543] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:24.183258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:25.223597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:26.865543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:26.919192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:27.779471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:28.326579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:28.329419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:28.437503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39683d61-f72a-4885-b4db-6e20d85f1de6 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:28.443321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:28.444201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:28.444517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:28.444796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] PATH_INFO: `/v3/users/9de956e0b7ea427f93d7e652095459a2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:28.445969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de956e0b7ea427f93d7e652095459a2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:28.449805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:28.511692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:28.513191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:28.527367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f98ff-0212-4c61-9eec-0c8c68bbbb6e service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:28.532363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:28.533194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:28.533486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:28.533757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] PATH_INFO: `/v3/users/762a5f04cbe24841b63eb9cda7203adf` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:28.535480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=762a5f04cbe24841b63eb9cda7203adf)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:28.537635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:28.722478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de956e0b7ea427f93d7e652095459a2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.736875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de956e0b7ea427f93d7e652095459a2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.737618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de956e0b7ea427f93d7e652095459a2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.801573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:28.816071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de956e0b7ea427f93d7e652095459a2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.824136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762a5f04cbe24841b63eb9cda7203adf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.834102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8c3e9cce-6b41-4a3b-b91c-ccd419290c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de956e0b7ea427f93d7e652095459a2'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.837627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762a5f04cbe24841b63eb9cda7203adf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.844373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 763/1544] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:28 2022] DELETE /identity/v3/users/9de956e0b7ea427f93d7e652095459a2 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:28.847139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:28.847139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:28.847546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:28.857164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762a5f04cbe24841b63eb9cda7203adf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.871609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762a5f04cbe24841b63eb9cda7203adf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:28.873750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:28.876959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:28.944371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 764/1545] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:28.954708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:28.956370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:28.985486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bd1a09c8-dd7f-46fe-86ff-f84d8aff28ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762a5f04cbe24841b63eb9cda7203adf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:29.004007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 782/1546] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:28 2022] DELETE /identity/v3/users/762a5f04cbe24841b63eb9cda7203adf => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:29.017935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:29.018329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:29.018682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:29.034062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ad009-713d-48fb-b7fa-e399eb8e4878 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:29.042233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:29.043591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:29.116462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:29.117199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:29.117425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:29.117705 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:29.123115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 783/1547] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:29.133348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:29.151310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:29.153013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:29.160589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b0ff-c08b-4550-9066-5bf8575d94d4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:29.165794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:29.166897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:29.167401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:29.167799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:29.174235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 765/1548] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:29.179536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:29.182293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:29.203609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 784/1549] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:29.629433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:29.876549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:29.876549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:29.897803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb0d6e-471b-4390-9d73-b2f1383ec5ee service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:29.903358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:29.903987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:29.904269 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:29.904582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] PATH_INFO: `/v3/projects/c320269d0c5b4e9195aa4f52a7650b8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:29.905906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c320269d0c5b4e9195aa4f52a7650b8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:29.908576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:30.022781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c320269d0c5b4e9195aa4f52a7650b8f', 'request_id': 'req-91bc4ccd-779c-4dc6-825f-545bae5d681a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.028499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c320269d0c5b4e9195aa4f52a7650b8f', 'request_id': 'req-91bc4ccd-779c-4dc6-825f-545bae5d681a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.035887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c320269d0c5b4e9195aa4f52a7650b8f', 'request_id': 'req-91bc4ccd-779c-4dc6-825f-545bae5d681a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.041446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:30.043275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:30.058625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b803e-f203-4d9b-b2cc-db111be0dc55 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:30.131117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:30.131765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:30.132082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:30.132306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] PATH_INFO: `/v3/projects/e477f94a2e1a49e2b247455dac9cd1b0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:30.133658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e477f94a2e1a49e2b247455dac9cd1b0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:30.135566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:30.154237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] The token cache is being invalidate because project c320269d0c5b4e9195aa4f52a7650b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:30.154797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.155946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.162442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 766/1550] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:29 2022] DELETE /identity/v3/projects/c320269d0c5b4e9195aa4f52a7650b8f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:30.164252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:30.166113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:30.181410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc4ccd-779c-4dc6-825f-545bae5d681a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:30.186710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:30.187345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:30.187623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:30.187893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] PATH_INFO: `/v3/users/e1025d14eb514641bb2407f8ffe6ccb6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:30.189711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1025d14eb514641bb2407f8ffe6ccb6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:30.191651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:30.269815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e477f94a2e1a49e2b247455dac9cd1b0', 'request_id': 'req-cf34c695-0168-45e0-8d8c-e407de5c800d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.277562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e477f94a2e1a49e2b247455dac9cd1b0', 'request_id': 'req-cf34c695-0168-45e0-8d8c-e407de5c800d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.334967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e477f94a2e1a49e2b247455dac9cd1b0', 'request_id': 'req-cf34c695-0168-45e0-8d8c-e407de5c800d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.351210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] The token cache is being invalidate because project e477f94a2e1a49e2b247455dac9cd1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:30.351569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.352497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.357461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 785/1551] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:30 2022] DELETE /identity/v3/projects/e477f94a2e1a49e2b247455dac9cd1b0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:30.358498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:30.360215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:30.401732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1025d14eb514641bb2407f8ffe6ccb6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.412053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1025d14eb514641bb2407f8ffe6ccb6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.413367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1025d14eb514641bb2407f8ffe6ccb6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.442817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c695-0168-45e0-8d8c-e407de5c800d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:30.449113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:30.450022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:30.450765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:30.450765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] PATH_INFO: `/v3/users/5509185fa66b402cb97fec6939f31aa3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:30.451789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5509185fa66b402cb97fec6939f31aa3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:30.453772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:30.509389 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1025d14eb514641bb2407f8ffe6ccb6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.522522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1025d14eb514641bb2407f8ffe6ccb6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.529082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 767/1552] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:30 2022] DELETE /identity/v3/users/e1025d14eb514641bb2407f8ffe6ccb6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:30.769349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5509185fa66b402cb97fec6939f31aa3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.777980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5509185fa66b402cb97fec6939f31aa3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.793445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5509185fa66b402cb97fec6939f31aa3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.794112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5509185fa66b402cb97fec6939f31aa3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.863034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5509185fa66b402cb97fec6939f31aa3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:30.872951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 786/1553] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:30 2022] DELETE /identity/v3/users/5509185fa66b402cb97fec6939f31aa3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:31.103837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:31.105432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:31.151542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:31.178627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58778c98-5536-4ce4-859a-bb6658eba873 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:31.207751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:31.234566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:31.235203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:31.235480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:31.235748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] PATH_INFO: `/v3/projects/3631ea3cf3fa4177ba8fe4cb9e227d9b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:31.237680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3631ea3cf3fa4177ba8fe4cb9e227d9b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:31.239653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:31.378467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3631ea3cf3fa4177ba8fe4cb9e227d9b', 'request_id': 'req-32721b27-4587-4dd5-b3e8-86a9ad174474'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.383926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3631ea3cf3fa4177ba8fe4cb9e227d9b', 'request_id': 'req-32721b27-4587-4dd5-b3e8-86a9ad174474'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.398274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:31.400142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3631ea3cf3fa4177ba8fe4cb9e227d9b', 'request_id': 'req-32721b27-4587-4dd5-b3e8-86a9ad174474'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.400274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:31.426860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9263f-7eb2-44f5-a926-08e7dae04c2b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:31.491017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:31.491667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:31.491956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:31.492232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] PATH_INFO: `/v3/projects/06674f115430492f8f7a6d2c858069bf` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:31.493480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06674f115430492f8f7a6d2c858069bf)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:31.495423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:31.506189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] The token cache is being invalidate because project 3631ea3cf3fa4177ba8fe4cb9e227d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:31.506489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.507143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.512720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 768/1554] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:31 2022] DELETE /identity/v3/projects/3631ea3cf3fa4177ba8fe4cb9e227d9b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:31.512720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:31.512720 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:31.526795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721b27-4587-4dd5-b3e8-86a9ad174474 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:31.531882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:31.532558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:31.533431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:31.533707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] PATH_INFO: `/v3/users/669ade692ce14da68f5f08469bd2a1dd` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:31.534848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669ade692ce14da68f5f08469bd2a1dd)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:31.536828 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:31.763511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06674f115430492f8f7a6d2c858069bf', 'request_id': 'req-f1103b76-989c-48cf-a40e-f5fb2c851ce7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.763678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669ade692ce14da68f5f08469bd2a1dd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.771021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06674f115430492f8f7a6d2c858069bf', 'request_id': 'req-f1103b76-989c-48cf-a40e-f5fb2c851ce7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.775993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669ade692ce14da68f5f08469bd2a1dd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.776928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669ade692ce14da68f5f08469bd2a1dd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.847092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06674f115430492f8f7a6d2c858069bf', 'request_id': 'req-f1103b76-989c-48cf-a40e-f5fb2c851ce7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.862218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] The token cache is being invalidate because project 06674f115430492f8f7a6d2c858069bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:31.862699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.864415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f1103b76-989c-48cf-a40e-f5fb2c851ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.872081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 787/1555] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:31 2022] DELETE /identity/v3/projects/06674f115430492f8f7a6d2c858069bf => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:31.872081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:31.872081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:31.872081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:31.887307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:31.888630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:31.938236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669ade692ce14da68f5f08469bd2a1dd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.947083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 788/1556] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:31.948009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:31.949299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:31.959310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-73f146ff-3f1b-484b-8b61-3065fe96fc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669ade692ce14da68f5f08469bd2a1dd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:31.961732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4ee6-e952-4933-bb0f-b6eb8e7243eb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:31.965799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 769/1557] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:31 2022] DELETE /identity/v3/users/669ade692ce14da68f5f08469bd2a1dd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:31.966516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:31.966999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55286c-078c-4a82-966b-77719dc89b9c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:31.967146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:31.967422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:31.967594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55286c-078c-4a82-966b-77719dc89b9c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:31.967704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] PATH_INFO: `/v3/users/5d28f70c7be341b1bb27420473090cd6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:31.968563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55286c-078c-4a82-966b-77719dc89b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:31.968986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d28f70c7be341b1bb27420473090cd6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:31.970916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:31.987995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ec55286c-078c-4a82-966b-77719dc89b9c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:31.989325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ec55286c-078c-4a82-966b-77719dc89b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.047239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 770/1558] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:32.049025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.049306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.049580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.067855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:32.069056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.076523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 771/1559] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:32.077304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.089009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457bfad-ccf3-42ef-b716-13084e4935bc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.094075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.095265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.095609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.095970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.096923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:32.097067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.098743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.112093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 772/1560] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:32.112974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.114645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.146150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d28f70c7be341b1bb27420473090cd6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.153099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d28f70c7be341b1bb27420473090cd6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.168042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d28f70c7be341b1bb27420473090cd6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.168827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d28f70c7be341b1bb27420473090cd6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.171357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02177bf7-6657-4972-ab47-55aa9c328b91 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.175536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.176137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.176438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.176714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.178410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.190563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.192017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.201264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 773/1561] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:32.202017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.203260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.214520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046012f-450e-4359-bb4b-6b3caa087546 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.219388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.220007 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.220381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.220712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.221340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.223262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.244298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d28f70c7be341b1bb27420473090cd6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.253100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 789/1562] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:31 2022] DELETE /identity/v3/users/5d28f70c7be341b1bb27420473090cd6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:32.332751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 774/1563] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:32 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:32.337093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.397419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ccffc-fa4d-4eeb-86d0-7eb5f59eece3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.464574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.465198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.465710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.465997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.466701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.468946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.567049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 790/1564] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:32 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:32.571444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.584468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10656-44ac-47c7-b3b8-5e32a9d4f75a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.591223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.592019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.592417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.592844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.593577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.595831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.611621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 775/1565] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:32.612969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.624733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac4ab3-eb62-45a6-958c-9a9f871a009c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.630096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.630478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.630761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.631037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.631693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.633370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.658281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 791/1566] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:32.658456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.676636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d20454-16d6-4342-88fe-51256f7bfe40 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.688600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.690223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.690223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.690223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] PATH_INFO: `/v3/projects/8084f9aced2548679b91877b2ca91903/users/a27548a6f1f4476ab19f83c76858abf1/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.706071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8084f9aced2548679b91877b2ca91903, user_id=a27548a6f1f4476ab19f83c76858abf1, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.709090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.750391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.752354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.764846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:32.765993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb6cd0-4197-4f62-b2a1-7fb6d64d68a3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.773025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.773025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.773025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.773025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] PATH_INFO: `/v3/projects/f4f4f0e43fca4e5e96d163989e874d3e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.774774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f4f0e43fca4e5e96d163989e874d3e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.776993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:32.819556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 776/1567] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:32 2022] PUT /identity/v3/projects/8084f9aced2548679b91877b2ca91903/users/a27548a6f1f4476ab19f83c76858abf1/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:32.821222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:32.830622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:32.911014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b2f9d-c6b0-467a-a225-7908cb35abbe admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:32.935503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f4f0e43fca4e5e96d163989e874d3e', 'request_id': 'req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.945578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f4f0e43fca4e5e96d163989e874d3e', 'request_id': 'req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:32.989622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:32.990516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:32.990799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:32.991117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] PATH_INFO: `/v3/projects/f22b9d67740544979dd944793875754a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:32.992539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22b9d67740544979dd944793875754a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:32.994482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.050328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f4f0e43fca4e5e96d163989e874d3e', 'request_id': 'req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.061914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] The token cache is being invalidate because project f4f4f0e43fca4e5e96d163989e874d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:33.062276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.063003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd0aefab-bf4d-4473-9cff-4ca28a6d8d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.067543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 792/1568] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:32 2022] DELETE /identity/v3/projects/f4f4f0e43fca4e5e96d163989e874d3e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:33.067543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.067543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.067543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.097904 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] MFA Rules not processed for user `a27548a6f1f4476ab19f83c76858abf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:33.099381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:33.175939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 793/1569] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:33.176903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.178179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:33.193762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487b5c2-622c-445c-9114-bb124dda44f6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.194222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22b9d67740544979dd944793875754a', 'request_id': 'req-aceeb962-21f6-4ccc-9237-b7a0985ba879'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.201555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22b9d67740544979dd944793875754a', 'request_id': 'req-aceeb962-21f6-4ccc-9237-b7a0985ba879'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.209509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22b9d67740544979dd944793875754a', 'request_id': 'req-aceeb962-21f6-4ccc-9237-b7a0985ba879'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.253775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.254454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.254793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.255074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] PATH_INFO: `/v3/users/d4dc81283aa341ffbfd8b27b96474e75` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.256216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4dc81283aa341ffbfd8b27b96474e75)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.258266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.318599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] The token cache is being invalidate because project f22b9d67740544979dd944793875754a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:33.318895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.319688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.325702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 777/1570] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:32 2022] DELETE /identity/v3/projects/f22b9d67740544979dd944793875754a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:33.325702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.325702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:33.338161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceeb962-21f6-4ccc-9237-b7a0985ba879 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.343618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3abb9-1190-435f-973e-9f98bb56c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.344235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3abb9-1190-435f-973e-9f98bb56c135 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.344592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3abb9-1190-435f-973e-9f98bb56c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.344872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3abb9-1190-435f-973e-9f98bb56c135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.346054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3abb9-1190-435f-973e-9f98bb56c135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.347976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3abb9-1190-435f-973e-9f98bb56c135 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.442455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4dc81283aa341ffbfd8b27b96474e75'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.450425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4dc81283aa341ffbfd8b27b96474e75'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.463145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4dc81283aa341ffbfd8b27b96474e75'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.463910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4dc81283aa341ffbfd8b27b96474e75'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.490546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 778/1571] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:33.492537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ccd9-b18e-4bdc-9cc9-e1e6c4671a55 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.493066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ccd9-b18e-4bdc-9cc9-e1e6c4671a55 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.493525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ccd9-b18e-4bdc-9cc9-e1e6c4671a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.516859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2386ccd9-b18e-4bdc-9cc9-e1e6c4671a55 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:33.519062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2386ccd9-b18e-4bdc-9cc9-e1e6c4671a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:33.564706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4dc81283aa341ffbfd8b27b96474e75'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:33.572130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 794/1572] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:33 2022] DELETE /identity/v3/users/d4dc81283aa341ffbfd8b27b96474e75 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:33.577460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.577460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:33.588453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 779/1573] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:33.594945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.595292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.597948 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.622500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:33.625385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:33.682648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d0a5b-59fd-4f8a-81cd-e895a9a06bbb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.689313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.689978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.690366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.691095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.691461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.693513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.710639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 780/1574] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:33.714776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.724752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2471a5-6c81-4798-bd01-4182d5541da2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.729285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.729873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.730152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.730424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.731068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:33.731369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.733001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.744503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 781/1575] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:08:33.748872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.758766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc11a-07ff-41ec-96a5-70fc2b3053d3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.763766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.764358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.764679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.764955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.765608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.768051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.801622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:33.808308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 795/1576] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:33.813916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.825124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c6708-977f-4453-b1c7-54e9d414900b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.831249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.831876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.832469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.832753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.833432 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.835065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.849260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 796/1577] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:33.850637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.861265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6a8e-2fe3-4dc9-bd85-71cae25ecdae admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.873046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.873879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.874176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.874449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] PATH_INFO: `/v3/projects/ad9d5b10be774c6c87f74711c17c596d/users/a8a599d99f8b4bf9a47186c69866cc6f/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.882827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 782/1578] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/projects => generated 361 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:33.883840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:33.898083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9d5b10be774c6c87f74711c17c596d, user_id=a8a599d99f8b4bf9a47186c69866cc6f, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.901830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:33.957525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ede6ac-9a77-4acc-9b5e-0516d37f7c43 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:33.962625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:33.963245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:33.963527 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:33.963888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:33.964565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:33.966531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.011398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 797/1579] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:33 2022] PUT /identity/v3/projects/ad9d5b10be774c6c87f74711c17c596d/users/a8a599d99f8b4bf9a47186c69866cc6f/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:34.015201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.095636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e5ac9-89d3-489b-8160-561fa1bce84c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.101109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.102277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.102561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.102945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.103611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.105260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.117495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 798/1580] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:34.122664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 783/1581] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:33 2022] POST /identity/v3/users => generated 281 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:34.130128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.130657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.140597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0d9a7-6729-4431-83bd-e1cda18371ec admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.141605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379095-d614-433e-9423-d2d05d6aff14 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.146431 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.147088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.147299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.147437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.147628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] PATH_INFO: `/v3/projects/ad9d5b10be774c6c87f74711c17c596d/users/a8a599d99f8b4bf9a47186c69866cc6f/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.148179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.148589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.148950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.150053 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.150156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9d5b10be774c6c87f74711c17c596d, user_id=a8a599d99f8b4bf9a47186c69866cc6f, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.152424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.152554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.166874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 799/1583] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:34.168026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.169970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.172602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 784/1583] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:34 2022] PUT /identity/v3/projects/ad9d5b10be774c6c87f74711c17c596d/users/a8a599d99f8b4bf9a47186c69866cc6f/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:34.173779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.183580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c52d84-b7db-46d4-85cb-ff2ac57311f2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.266123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb7986-d05c-4e47-b6da-edbbe5d82395 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.268029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.270176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.270624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.271664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] PATH_INFO: `/v3/projects/a8f86b5507fe43409bcfb96dfb958145` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.274228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effa73-b50a-4b60-9645-d46d702b0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.274562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f86b5507fe43409bcfb96dfb958145)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.274851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effa73-b50a-4b60-9645-d46d702b0a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.275133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effa73-b50a-4b60-9645-d46d702b0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.275405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effa73-b50a-4b60-9645-d46d702b0a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.276062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effa73-b50a-4b60-9645-d46d702b0a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.277699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6effa73-b50a-4b60-9645-d46d702b0a82 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.279692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.296812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 785/1584] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:34.296812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.296812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.296812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.336801 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] MFA Rules not processed for user `a8a599d99f8b4bf9a47186c69866cc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:34.338376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.430890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 786/1585] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:34.431955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.435830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f86b5507fe43409bcfb96dfb958145', 'request_id': 'req-bcd4877e-2223-47f8-93df-25c1543f7b9e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:34.449295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4fffe-b928-45b1-8cae-fba31cc21d2f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.460372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f86b5507fe43409bcfb96dfb958145', 'request_id': 'req-bcd4877e-2223-47f8-93df-25c1543f7b9e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:34.524296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae135e-fa62-4d5c-aab0-9ddf6fe84452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.525106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae135e-fa62-4d5c-aab0-9ddf6fe84452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.525630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae135e-fa62-4d5c-aab0-9ddf6fe84452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.526009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae135e-fa62-4d5c-aab0-9ddf6fe84452 admin admin] PATH_INFO: `/v3/projects/52895e1999bf4f0aa84d4871784b368e/users/c08bdba36fd44fedbaa1060be500a962/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.544309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae135e-fa62-4d5c-aab0-9ddf6fe84452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52895e1999bf4f0aa84d4871784b368e, user_id=c08bdba36fd44fedbaa1060be500a962, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.547585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae135e-fa62-4d5c-aab0-9ddf6fe84452 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.558754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f86b5507fe43409bcfb96dfb958145', 'request_id': 'req-bcd4877e-2223-47f8-93df-25c1543f7b9e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:34.571536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] The token cache is being invalidate because project a8f86b5507fe43409bcfb96dfb958145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:34.571829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:34.572594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:34.574381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 800/1586] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:34 2022] DELETE /identity/v3/projects/a8f86b5507fe43409bcfb96dfb958145 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:34.574951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.576463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.643452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 787/1587] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:34 2022] PUT /identity/v3/projects/52895e1999bf4f0aa84d4871784b368e/users/c08bdba36fd44fedbaa1060be500a962/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:34.651660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb8bf-8d83-458c-a4e3-936d5b93b629 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.652890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb8bf-8d83-458c-a4e3-936d5b93b629 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.653342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bb8bf-8d83-458c-a4e3-936d5b93b629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.683643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-956bb8bf-8d83-458c-a4e3-936d5b93b629 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:34.685166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-956bb8bf-8d83-458c-a4e3-936d5b93b629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.712665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4877e-2223-47f8-93df-25c1543f7b9e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.781727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.783011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.783410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.783753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.785905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.796762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 788/1588] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:34.798933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.799382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.799802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.834615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] MFA Rules not processed for user `c08bdba36fd44fedbaa1060be500a962`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:34.837109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.872961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.874662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fcc7-719c-42a4-aca9-3e88965352e9 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:34.888199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 801/1589] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:34.890155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.890704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.891211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.918386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:34.919260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 789/1590] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:34.925280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:34.944203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 802/1591] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:34.955284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:34.974072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888010f7-79e9-4013-9301-fbe48b128f7a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:34.990842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:34.990842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:34.990842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:34.990842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:34.991125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:34.991125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:34.991125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.013283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 790/1592] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:35.016346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.042473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e846d-60e8-4df7-8e5f-6651b0b21165 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.067374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.067374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.067374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.067374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.067672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.068035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.092202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.095793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:35.121523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e60541-dfd8-4152-a275-2a3a6bf9a5ef admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.131755 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.132419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.132707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.132986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.148176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.150454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.171987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 791/1593] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:35.187588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 803/1594] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:35 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:35.189341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.202056 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.217241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d195-04ac-472d-974c-26926c489a75 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.305473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.306153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.306363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.307295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.307966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.310652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.373192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:35.374677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f0171-f888-4d3e-940d-0259b9192959 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.379988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.380926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.382438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.382438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.383607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:35.407781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 792/1595] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:35 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:35.408793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.410825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:35.425421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85318442-ffbb-4ed6-8cb3-313acb73a0eb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.430788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.431605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.432063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.432420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] PATH_INFO: `/v3/users/c08bdba36fd44fedbaa1060be500a962` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.433708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08bdba36fd44fedbaa1060be500a962)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.436154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.461338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.470575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.483738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 804/1596] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:35.484964 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.496161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc2649-2196-4617-bc98-366ddefb2e5e service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.502155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.503088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.503384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.503665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.504380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.506497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.524054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 805/1597] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:35.529582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.547338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d307c12-0c90-4417-9ae4-4e621412a8c2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.553879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.554645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.556233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.556233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.556233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.557701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.572321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 806/1598] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:35.573789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.586061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a529f-2ba5-406a-8d00-345f67eb6810 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:35.591069 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbd5dd-1e43-4be5-9817-f03c5ff4b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:35.591882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd5dd-1e43-4be5-9817-f03c5ff4b8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.592242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd5dd-1e43-4be5-9817-f03c5ff4b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.592624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbd5dd-1e43-4be5-9817-f03c5ff4b8f5 admin admin] PATH_INFO: `/v3/projects/26c9a6a3a18c447793629cb3bebdfb53/users/5e4220d79a584bddbfc7cac00fb81b76/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.629810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbd5dd-1e43-4be5-9817-f03c5ff4b8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9a6a3a18c447793629cb3bebdfb53, user_id=5e4220d79a584bddbfc7cac00fb81b76, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:35.633411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbd5dd-1e43-4be5-9817-f03c5ff4b8f5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:35.646954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08bdba36fd44fedbaa1060be500a962'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:35.667226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08bdba36fd44fedbaa1060be500a962'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:35.668520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08bdba36fd44fedbaa1060be500a962'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:35.744722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08bdba36fd44fedbaa1060be500a962'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:35.757981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 807/1599] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:35 2022] PUT /identity/v3/projects/26c9a6a3a18c447793629cb3bebdfb53/users/5e4220d79a584bddbfc7cac00fb81b76/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:35.773727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.780843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.780843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.784333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8aace70d-21a0-4be9-8245-606a896860b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08bdba36fd44fedbaa1060be500a962'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:35.800033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 793/1600] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:35 2022] DELETE /identity/v3/users/c08bdba36fd44fedbaa1060be500a962 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:35.804197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:35.804511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:35.804788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:35.832128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] MFA Rules not processed for user `5e4220d79a584bddbfc7cac00fb81b76`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:35.833658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:35.839743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:35.841150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:35.968091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 794/1601] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:35.979562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:35.981428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:35.992350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 808/1602] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:36.004703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.009082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:36.021996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:36.031892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40e352-f1b7-4a04-8435-055f4ac604ff None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.037173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.038040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.038324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.038603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.039246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.041472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.065081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49476695-7ce5-4920-90f9-b25390cd6d2c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.070631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.071340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.071990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.072266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.086081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.088239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.101107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 795/1603] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:36.108498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.109928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:36.125227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a29c8-377c-499b-b3a2-29bafd6b9699 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.131108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.131777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.132061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.132320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] PATH_INFO: `/v3/users/a27548a6f1f4476ab19f83c76858abf1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.133561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a27548a6f1f4476ab19f83c76858abf1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.135500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.161100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 809/1604] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:36 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:36.165269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.251900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563940ff-f33d-47d7-ab8f-1fc27015f8c7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.251900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.252187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.252989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.253281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.253939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.257760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.371343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 810/1605] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:36 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:36.372729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.387947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1a8e-d40d-4d41-b772-7c22efef1375 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.391362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.392066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.392328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.392658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.393435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.395290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.403537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a27548a6f1f4476ab19f83c76858abf1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.414857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 811/1606] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:36.415877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.420632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a27548a6f1f4476ab19f83c76858abf1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.421373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a27548a6f1f4476ab19f83c76858abf1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.429315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46442f7-c705-4730-b131-e594eb97e36a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.435954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.439546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.439546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.439546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] PATH_INFO: `/v3/projects/487dddc8de604d158c93bca0d96c3aef/users/106348d53cc7457684de6c6a76f90075/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.454641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487dddc8de604d158c93bca0d96c3aef, user_id=106348d53cc7457684de6c6a76f90075, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.457841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.495679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a27548a6f1f4476ab19f83c76858abf1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.509961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b479e37e-7131-47cb-9f3f-922883486749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a27548a6f1f4476ab19f83c76858abf1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.517430 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 796/1607] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:36 2022] DELETE /identity/v3/users/a27548a6f1f4476ab19f83c76858abf1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:36.522407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.522794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.523192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.535233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 812/1608] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:36 2022] PUT /identity/v3/projects/487dddc8de604d158c93bca0d96c3aef/users/106348d53cc7457684de6c6a76f90075/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:36.541685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.543727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:36.578908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:36.582792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:36.712716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a939-9d9f-49c9-88d7-158f72956770 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.722700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.723650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.723912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.724169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.725747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.728147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.737183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 797/1609] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:36.738298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.740106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:36.750897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 813/1610] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:36.752147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.752843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e49ad-6123-47c1-bc09-4fa1835b3073 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.754773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:36.764773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.765345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.765629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.765907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] PATH_INFO: `/v3/projects/52895e1999bf4f0aa84d4871784b368e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.767666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52895e1999bf4f0aa84d4871784b368e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.769997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.824899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d51c83-f2f2-46ce-9c94-77aa4cfa37a4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.831078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.832252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.832689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.833121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.847815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.849300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.859781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 814/1611] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:36.860669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:36.878157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bbaca-af0c-4470-8985-b0326157ed68 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:36.889909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52895e1999bf4f0aa84d4871784b368e', 'request_id': 'req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.903909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52895e1999bf4f0aa84d4871784b368e', 'request_id': 'req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.914062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52895e1999bf4f0aa84d4871784b368e', 'request_id': 'req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:36.964436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c529f59-853b-41ad-8c2c-0c449ac2794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:36.965162 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c529f59-853b-41ad-8c2c-0c449ac2794b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.965445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c529f59-853b-41ad-8c2c-0c449ac2794b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.965720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c529f59-853b-41ad-8c2c-0c449ac2794b admin admin] PATH_INFO: `/v3/projects/487dddc8de604d158c93bca0d96c3aef/users/106348d53cc7457684de6c6a76f90075/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:36.969332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c529f59-853b-41ad-8c2c-0c449ac2794b admin admin] RBAC: Authorizing `identity:create_grant(project_id=487dddc8de604d158c93bca0d96c3aef, user_id=106348d53cc7457684de6c6a76f90075, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:36.972054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c529f59-853b-41ad-8c2c-0c449ac2794b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:36.992335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 815/1612] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:36 2022] PUT /identity/v3/projects/487dddc8de604d158c93bca0d96c3aef/users/106348d53cc7457684de6c6a76f90075/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:36.994005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:36.994296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:36.994569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.030703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] MFA Rules not processed for user `106348d53cc7457684de6c6a76f90075`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:37.031878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.121291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 816/1613] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:37.135604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.136361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] The token cache is being invalidate because project 52895e1999bf4f0aa84d4871784b368e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:37.137115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.137232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.137565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c8999be1-1304-4b9c-b7c2-d0bbfb8289d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.143543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 798/1614] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:36 2022] DELETE /identity/v3/projects/52895e1999bf4f0aa84d4871784b368e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:37.145028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.145408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.145826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.173249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:37.175479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.208685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cacd2-f9c1-40de-8c45-cb1486e075c0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.219589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.220415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.220803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.221081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.224311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.244732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.246379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff2af1-ee79-4969-aceb-ff89ce43f06b service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.260426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 817/1615] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:37.272662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 799/1616] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:37.276161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.276558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.276900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.303743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:37.305022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.317577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 818/1617] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:37.321946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.332005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f164b-20cb-432a-be41-c3f251ede4ac None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.336782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.341689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.341689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.341689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.341689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:37.341689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.341689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.352495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 800/1618] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:37.357024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.367347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424651d-5e43-4c1f-8747-ed81aa06c1d8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.372349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.372991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.373272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.373547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.374280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.377036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.396283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.398203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.411940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8fded-0395-4e7d-bb88-a11484c2316d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.416948 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.418522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.418522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.418522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] PATH_INFO: `/v3/projects/8084f9aced2548679b91877b2ca91903` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.419700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8084f9aced2548679b91877b2ca91903)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.421751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.466838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:37.475645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 819/1619] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:37 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:37.479575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.561235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8b6b-d528-4aed-ae16-db58b77c221e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.579358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.580526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.580964 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.582136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.583251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.584581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8084f9aced2548679b91877b2ca91903', 'request_id': 'req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.587029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.594782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8084f9aced2548679b91877b2ca91903', 'request_id': 'req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.601968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8084f9aced2548679b91877b2ca91903', 'request_id': 'req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.684211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 820/1620] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:37 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:37.688227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.698043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c4e7c-b183-4424-a728-92a4fbfd0ae9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.721985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] The token cache is being invalidate because project 8084f9aced2548679b91877b2ca91903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:37.722630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.723669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:37.726636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 801/1621] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:37 2022] DELETE /identity/v3/projects/8084f9aced2548679b91877b2ca91903 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:37.730599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.732914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.818781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.819413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.819692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.819960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.820725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.822864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.836428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 821/1622] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:37.838262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.840557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:37.855116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb87ef-7a1c-4d72-a463-78a0f1f3691f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.861324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.862374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e354fb-c66a-46eb-99fb-aabf9cb073ff admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.862719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.863007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.863287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.863936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.865731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.868435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.868762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.869040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.869381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] PATH_INFO: `/v3/users/a8a599d99f8b4bf9a47186c69866cc6f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.870537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a599d99f8b4bf9a47186c69866cc6f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.872505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:37.881303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 822/1623] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:37.885594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:37.897318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40577ca-bcd9-42db-b499-203c3ae9d3aa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:37.903568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0757417-4616-4044-bbe0-5821d45641c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:37.912344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0757417-4616-4044-bbe0-5821d45641c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:37.912344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0757417-4616-4044-bbe0-5821d45641c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:37.912344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0757417-4616-4044-bbe0-5821d45641c1 admin admin] PATH_INFO: `/v3/projects/a74cce9f71c94da29c2ecb09f57ea183/users/b7232ae4c5e8403a9c4ecf13d4bd5544/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:37.922329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0757417-4616-4044-bbe0-5821d45641c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74cce9f71c94da29c2ecb09f57ea183, user_id=b7232ae4c5e8403a9c4ecf13d4bd5544, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:37.925872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0757417-4616-4044-bbe0-5821d45641c1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:38.050636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 823/1624] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:37 2022] PUT /identity/v3/projects/a74cce9f71c94da29c2ecb09f57ea183/users/b7232ae4c5e8403a9c4ecf13d4bd5544/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:38.060742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:38.061167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:38.061661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:38.096409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] MFA Rules not processed for user `b7232ae4c5e8403a9c4ecf13d4bd5544`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:38.097682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:38.146467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a599d99f8b4bf9a47186c69866cc6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:38.157173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a599d99f8b4bf9a47186c69866cc6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:38.159630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a599d99f8b4bf9a47186c69866cc6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:38.184572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 824/1625] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:38.191914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:38.193543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:38.249274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a599d99f8b4bf9a47186c69866cc6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:38.259817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e31d3f-02a1-4d5e-adc4-e7b1bec85d64 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:38.263779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:38.264513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:38.264972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:38.265324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:38.286613 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a599d99f8b4bf9a47186c69866cc6f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:38.294744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 802/1626] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:37 2022] DELETE /identity/v3/users/a8a599d99f8b4bf9a47186c69866cc6f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:38.300244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:38.301273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:38.316667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 825/1627] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:38.516453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:38.875553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:38.875553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:38.967160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863755b7-0840-4730-a2ba-97d038df1158 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:38.973218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:38.974194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:38.974499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:38.974841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] PATH_INFO: `/v3/users/5e4220d79a584bddbfc7cac00fb81b76` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:38.976164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4220d79a584bddbfc7cac00fb81b76)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:38.978306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:39.034151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:39.035583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:39.151136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bea2b-6afa-4d43-adb0-dc58fd29a184 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:39.156054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:39.156753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.157224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.157506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] PATH_INFO: `/v3/projects/ad9d5b10be774c6c87f74711c17c596d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.168463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9d5b10be774c6c87f74711c17c596d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:39.168463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:39.169434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:39.240530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4220d79a584bddbfc7cac00fb81b76'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.247616 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4220d79a584bddbfc7cac00fb81b76'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.248380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4220d79a584bddbfc7cac00fb81b76'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.290626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9d5b10be774c6c87f74711c17c596d', 'request_id': 'req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.297055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9d5b10be774c6c87f74711c17c596d', 'request_id': 'req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.343647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4220d79a584bddbfc7cac00fb81b76'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.356229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3e599ed6-9897-4cd4-bea6-8d10b6834581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4220d79a584bddbfc7cac00fb81b76'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.362214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 803/1628] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:38 2022] DELETE /identity/v3/users/5e4220d79a584bddbfc7cac00fb81b76 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:39.366567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.366857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.367134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.386199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:39.387571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:39.419092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9d5b10be774c6c87f74711c17c596d', 'request_id': 'req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.432610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] The token cache is being invalidate because project ad9d5b10be774c6c87f74711c17c596d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:39.432610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.433389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5a28ca3e-5a52-4d30-a11f-655ab5c8ec1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:39.435196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 826/1629] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:39 2022] DELETE /identity/v3/projects/ad9d5b10be774c6c87f74711c17c596d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:39.440620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c1a38-d7e5-4e98-ab1d-327713eb066f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.440907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c1a38-d7e5-4e98-ab1d-327713eb066f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.441187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c1a38-d7e5-4e98-ab1d-327713eb066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.453850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 804/1630] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:39.465210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c02c1a38-d7e5-4e98-ab1d-327713eb066f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:39.466238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:39.466641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c02c1a38-d7e5-4e98-ab1d-327713eb066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:39.467054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:39.475785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 827/1631] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:39.483787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.484073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.484347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.510884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:39.512106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:39.524811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 828/1632] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:39.525812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:39.541788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6d34-00e5-40f7-9667-7b00ebb23efe None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:39.548917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:39.549771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.550159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.550579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.551325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:39.551785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:39.553526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:39.564475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83498d26-dcfb-4e48-8f45-9d47835641c4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:39.569812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:39.571195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.571630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.572574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.578617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 829/1633] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:39.579994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:39.589334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:39.591250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682e5ab-f51e-43ee-8b6e-1093fb4f0e09 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:39.591467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:39.595783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:39.596556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.596882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.597161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.597804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:39.600031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:39.614213 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 805/1634] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:39.792495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 830/1635] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:39 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:39.793836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:39.805915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06117ef-9944-4158-b1db-5b7b24efe123 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:39.868746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:39.869357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:39.869636 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:39.869955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:39.870619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:39.872560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.051080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 806/1636] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:39 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:40.052271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:40.062515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13c83-c140-42c0-91e1-9ebb94c12103 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:40.067088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:40.067688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.067975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.068248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.068944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:40.070778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.081156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 831/1637] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:40.092369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:40.103961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424d885-90d4-4de2-87b6-01f441e9f541 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:40.108875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:40.109422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.109702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.109976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.111323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:40.113124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.124432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 807/1638] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:40.128222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:40.138280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a13a2-1bdc-4f33-a539-8ec9155942cf admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:40.144380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:40.156685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cecfda-2b12-4dc3-8336-1ffdd257ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:40.156685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cecfda-2b12-4dc3-8336-1ffdd257ce4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.156685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cecfda-2b12-4dc3-8336-1ffdd257ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.156685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cecfda-2b12-4dc3-8336-1ffdd257ce4b admin admin] PATH_INFO: `/v3/projects/80c066787f8a40328409e4a6201fdc71/users/b7bd73ef4d5142aba2d31e2fa39a9da1/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.163611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cecfda-2b12-4dc3-8336-1ffdd257ce4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c066787f8a40328409e4a6201fdc71, user_id=b7bd73ef4d5142aba2d31e2fa39a9da1, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:40.166334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cecfda-2b12-4dc3-8336-1ffdd257ce4b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.184291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:40.186684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:40.201222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0742-db06-406f-95a6-6f69f52378f7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:40.206006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:40.206907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.208492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.208492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] PATH_INFO: `/v3/projects/26c9a6a3a18c447793629cb3bebdfb53` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.209534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c9a6a3a18c447793629cb3bebdfb53)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:40.211712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.255378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 832/1639] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:40 2022] PUT /identity/v3/projects/80c066787f8a40328409e4a6201fdc71/users/b7bd73ef4d5142aba2d31e2fa39a9da1/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:40.267007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.267303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.267626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.300375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] MFA Rules not processed for user `b7bd73ef4d5142aba2d31e2fa39a9da1`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:40.300375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:40.359894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c9a6a3a18c447793629cb3bebdfb53', 'request_id': 'req-9c294b21-1ce5-420d-b91f-47b7e7b3f017'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.374167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c9a6a3a18c447793629cb3bebdfb53', 'request_id': 'req-9c294b21-1ce5-420d-b91f-47b7e7b3f017'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.382557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c9a6a3a18c447793629cb3bebdfb53', 'request_id': 'req-9c294b21-1ce5-420d-b91f-47b7e7b3f017'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.398555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 833/1640] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:40.491428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] The token cache is being invalidate because project 26c9a6a3a18c447793629cb3bebdfb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:40.491722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.492362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.493903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 808/1641] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:40 2022] DELETE /identity/v3/projects/26c9a6a3a18c447793629cb3bebdfb53 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:40.498466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:40.523152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:40.524710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:40.561861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e4af0-8acc-4c2a-9b26-30c7f173fbef None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:40.584255 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c294b21-1ce5-420d-b91f-47b7e7b3f017 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:40.589890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:40.590704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.591152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.591577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.593699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:40.632090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:40.633462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:40.633967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:40.634244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] PATH_INFO: `/v3/users/106348d53cc7457684de6c6a76f90075` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:40.635428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106348d53cc7457684de6c6a76f90075)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:40.637441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.673016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:40.675170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:40.686214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 809/1642] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:40.876426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106348d53cc7457684de6c6a76f90075'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.879082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106348d53cc7457684de6c6a76f90075'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.893228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106348d53cc7457684de6c6a76f90075'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:40.893965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106348d53cc7457684de6c6a76f90075'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:41.395248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-545fd070-22fc-476d-9929-75a0d25749a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106348d53cc7457684de6c6a76f90075'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:41.396553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 834/1643] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:40 2022] DELETE /identity/v3/users/106348d53cc7457684de6c6a76f90075 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:41.912064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:41.912064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:41.949870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100fafc-bbff-4d91-8cc7-442fba410061 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.018711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:42.025220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.025859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.026141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.026418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] PATH_INFO: `/v3/projects/487dddc8de604d158c93bca0d96c3aef` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.027594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=487dddc8de604d158c93bca0d96c3aef)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.029604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.120707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487dddc8de604d158c93bca0d96c3aef', 'request_id': 'req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:42.126678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487dddc8de604d158c93bca0d96c3aef', 'request_id': 'req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:42.131872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:42.132960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487dddc8de604d158c93bca0d96c3aef', 'request_id': 'req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:42.206950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] The token cache is being invalidate because project 487dddc8de604d158c93bca0d96c3aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:42.211164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:42.211164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e557e57d-4b1f-4e11-a54d-7b92c60e6bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:42.211164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 810/1644] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:41 2022] DELETE /identity/v3/projects/487dddc8de604d158c93bca0d96c3aef => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:42.215363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.215758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.216031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.236091 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:42.237454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:42.297804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 835/1645] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:42.305593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.305994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.306364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.328086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:42.331231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:42.338465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 811/1646] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:42.342838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:42.352372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b8725-ef71-43fc-80d2-279aa230bf2c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.356919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.357516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.357799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.358075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.358723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:42.359024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.360667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.371833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 836/1647] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:42.377311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:42.385837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6ea55-93ec-4050-b873-964972979d84 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.393030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.393650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.394633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.394633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.394908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.396850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.481538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 812/1648] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:42 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:42.485868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:42.495944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e143bc-5989-46d3-b37b-cb2a0f76447f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.555690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.556310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.556627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.556905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.557584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.559529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.694531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 837/1649] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:42 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:42.698624 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:42.710642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6b395-373e-4f72-b625-5b69c74339fc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.715711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.716083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.716366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.716717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.717374 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.718961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.732010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 813/1650] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:42.733311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:42.743946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02d5dd-83c6-42b0-b303-39b9369830a8 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.748629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b9234-4843-4526-8039-5f3a60c843a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.749238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b9234-4843-4526-8039-5f3a60c843a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.749516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b9234-4843-4526-8039-5f3a60c843a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.749785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b9234-4843-4526-8039-5f3a60c843a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.750422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b9234-4843-4526-8039-5f3a60c843a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.752675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b9234-4843-4526-8039-5f3a60c843a2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.766686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 838/1651] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:42.770467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:42.780426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbf0d5-0fdd-4e5b-a8ca-c11123fe0ac7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:42.784985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:42.785626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.785909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.786184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] PATH_INFO: `/v3/projects/1ac35255f322479085253e51c93b25a2/users/771c644b3714439eab7a2bd5cc1663f1/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.800970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac35255f322479085253e51c93b25a2, user_id=771c644b3714439eab7a2bd5cc1663f1, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:42.803654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:42.889713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 814/1652] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:42 2022] PUT /identity/v3/projects/1ac35255f322479085253e51c93b25a2/users/771c644b3714439eab7a2bd5cc1663f1/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:42.901700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666735-0778-401e-817a-7d8675572b8a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:42.901985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666735-0778-401e-817a-7d8675572b8a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:42.902260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666735-0778-401e-817a-7d8675572b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:42.931447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-86666735-0778-401e-817a-7d8675572b8a None None] MFA Rules not processed for user `771c644b3714439eab7a2bd5cc1663f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:42.932774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-86666735-0778-401e-817a-7d8675572b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:42.997079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 839/1653] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:43.008555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:43.010309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:43.080181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c9777-e098-4828-9d90-8c1f301b843a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:43.084246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8320b3-585c-4613-85c1-73dbbeeff0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:43.084955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8320b3-585c-4613-85c1-73dbbeeff0cb service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:43.085238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8320b3-585c-4613-85c1-73dbbeeff0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:43.085508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8320b3-585c-4613-85c1-73dbbeeff0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:43.095055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8320b3-585c-4613-85c1-73dbbeeff0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:43.101571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8320b3-585c-4613-85c1-73dbbeeff0cb service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:43.106029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 815/1654] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:43.378156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:43.423237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:43.512440 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666735-0778-401e-817a-7d8675572b8a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:43.514050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-86666735-0778-401e-817a-7d8675572b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:43.584380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666735-0778-401e-817a-7d8675572b8a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:43.589023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:43.589656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:43.589977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:43.590365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] PATH_INFO: `/v3/users/b7232ae4c5e8403a9c4ecf13d4bd5544` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:43.591491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7232ae4c5e8403a9c4ecf13d4bd5544)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:43.593452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:43.782607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7232ae4c5e8403a9c4ecf13d4bd5544'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:43.789895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7232ae4c5e8403a9c4ecf13d4bd5544'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:43.804425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7232ae4c5e8403a9c4ecf13d4bd5544'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:43.805230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7232ae4c5e8403a9c4ecf13d4bd5544'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:43.908788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7232ae4c5e8403a9c4ecf13d4bd5544'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:43.915094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 840/1655] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:43 2022] DELETE /identity/v3/users/b7232ae4c5e8403a9c4ecf13d4bd5544 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:43.921110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:43.921391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:43.921689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:43.946034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:43.947304 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:44.013300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 816/1656] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:44.023381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:44.024908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:44.081911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb2b62-8058-4b7a-8725-11b9c6752f05 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:44.085574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ded6d-091d-47a8-9824-64f435cf7359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:44.086179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ded6d-091d-47a8-9824-64f435cf7359 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:44.086486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ded6d-091d-47a8-9824-64f435cf7359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:44.086759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ded6d-091d-47a8-9824-64f435cf7359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:44.095641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ded6d-091d-47a8-9824-64f435cf7359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:44.097107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ded6d-091d-47a8-9824-64f435cf7359 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:44.106522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 841/1657] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:44.118314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:44.571914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:44.573827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:44.588023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6f7c-b14d-4a5a-af46-153048e128a4 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:44.596013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:44.596672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:44.597033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:44.597317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] PATH_INFO: `/v3/projects/a74cce9f71c94da29c2ecb09f57ea183` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:44.598539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74cce9f71c94da29c2ecb09f57ea183)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:44.600543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:44.692214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74cce9f71c94da29c2ecb09f57ea183', 'request_id': 'req-d37865e5-a864-4ece-b0f2-4edebefd6e1e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:44.697827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74cce9f71c94da29c2ecb09f57ea183', 'request_id': 'req-d37865e5-a864-4ece-b0f2-4edebefd6e1e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:44.705491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74cce9f71c94da29c2ecb09f57ea183', 'request_id': 'req-d37865e5-a864-4ece-b0f2-4edebefd6e1e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:44.777477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] The token cache is being invalidate because project a74cce9f71c94da29c2ecb09f57ea183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:44.777477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:44.777477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d37865e5-a864-4ece-b0f2-4edebefd6e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:44.778572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 817/1658] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:44 2022] DELETE /identity/v3/projects/a74cce9f71c94da29c2ecb09f57ea183 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:44.784097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:44.784773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:44.784874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:44.805022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:44.807422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:44.866635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 842/1659] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:44.875788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:44.876071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:44.876344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:44.899068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:44.900601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:44.910764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 818/1660] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:44.914812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:44.929071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6a2f-5cfe-4474-92cc-b2caafbab09f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:44.930885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:44.931471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:44.931748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:44.932017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:44.932694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:44.932999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:44.934601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:44.947278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 843/1661] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:44.951713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:44.962812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9925f-0322-46c6-b22e-59b28166194b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:44.968494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:44.969897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:44.970031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:44.970312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:44.970951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:44.972956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.073617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 819/1662] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:44 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:45.079187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.096418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9ab45-d309-425f-91f7-758bf262b747 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:45.170908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:45.171520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.171801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.172073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.173280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:45.175201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.271982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 844/1663] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:45 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:45.273427 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.284045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd029-5987-4420-86e1-82f8b4ed1022 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:45.288747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:45.289434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.289779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.291308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.292179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:45.294009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.305506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 820/1664] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:45.309603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.320008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59576f86-50ba-470f-83d8-ef09858072b9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:45.325132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6147-7dd3-48cf-b859-5f6b093599cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:45.325841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6147-7dd3-48cf-b859-5f6b093599cf admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.326196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6147-7dd3-48cf-b859-5f6b093599cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.326660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6147-7dd3-48cf-b859-5f6b093599cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.327371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6147-7dd3-48cf-b859-5f6b093599cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:45.329214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6147-7dd3-48cf-b859-5f6b093599cf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.340697 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 845/1665] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:45.341294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:45.345465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.355314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2b3a6-64f1-468b-a0f2-8a7046381e0e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:45.360557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:45.361220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.361500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.361882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] PATH_INFO: `/v3/projects/11771a0ff6054fee9e94a3bda6904664/users/c3315df6868b471983c34f2dcb71bc8f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.376854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11771a0ff6054fee9e94a3bda6904664, user_id=c3315df6868b471983c34f2dcb71bc8f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:45.379509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.461717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 821/1666] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:45 2022] PUT /identity/v3/projects/11771a0ff6054fee9e94a3bda6904664/users/c3315df6868b471983c34f2dcb71bc8f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:45.463277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.463637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.464001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.493154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] MFA Rules not processed for user `c3315df6868b471983c34f2dcb71bc8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:45.494377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:45.564787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 846/1667] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:45.566085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.630651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd6fd8-edaf-432f-ace0-68310295212b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:45.635921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:45.636851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.643593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.643593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.643593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:45.643593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.761606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 822/1668] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:45 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:45.766392 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.778281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211e2b6-befc-456f-a84a-70e2620477d0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:45.833984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:45.834681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:45.834865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:45.835138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:45.835775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:45.837787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:45.984114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 847/1669] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:45 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:45.985719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:45.996591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d168ec-e25c-40fa-b223-5441f549f600 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.001357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:46.002370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.003160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.003502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.003852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.004606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.006417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.017973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 823/1670] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:46.022682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.032875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1fe99-5f48-4f56-b552-b31cc95917d1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.037570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3043e-b52c-4c65-89f0-20ea3ffb9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.038167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3043e-b52c-4c65-89f0-20ea3ffb9132 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.038449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3043e-b52c-4c65-89f0-20ea3ffb9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.038721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3043e-b52c-4c65-89f0-20ea3ffb9132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.039386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3043e-b52c-4c65-89f0-20ea3ffb9132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.041047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3043e-b52c-4c65-89f0-20ea3ffb9132 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.051057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 848/1671] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:46.055383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.065796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea4d0-2b7a-4a5e-b29f-4d42a99c0606 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.070549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.071286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.071679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.071922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] PATH_INFO: `/v3/projects/2fd61a4386d9485b9d627dbd12ce02d6/users/7fdffdddd06644ac84091aa316e1b15e/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.088545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd61a4386d9485b9d627dbd12ce02d6, user_id=7fdffdddd06644ac84091aa316e1b15e, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.092258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.177874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 824/1672] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:46 2022] PUT /identity/v3/projects/2fd61a4386d9485b9d627dbd12ce02d6/users/7fdffdddd06644ac84091aa316e1b15e/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:46.189739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.190110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.192025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.221228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] MFA Rules not processed for user `7fdffdddd06644ac84091aa316e1b15e`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:46.222553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:46.301802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 849/1673] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:46.305920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.342530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:46.399507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba330f7-4cac-4673-8689-06b2e10eaf1b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.404235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.404881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.405165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.405445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.406082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.408083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.503384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 825/1674] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:46 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:46.504300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.515798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef070-d98e-4a62-adb3-accd311ec81b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.590455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.591368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.592288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.593179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.593383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.595604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.698770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 850/1675] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:46 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:46.702742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.715086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bff719-e8f5-412a-8676-106e49312c12 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.723171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.725820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.725820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.725820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.728119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.730063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.746726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 826/1676] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:46.748420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.762156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd057ba-2265-4305-88f5-d7ee5a26b055 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.771312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.772533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.772989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.773105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] PATH_INFO: `/v3/projects/889434c44c924691803d369b18f228d2/users/f3c88a752cc84d63b25fed2fc46f05d0/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.790661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889434c44c924691803d369b18f228d2, user_id=f3c88a752cc84d63b25fed2fc46f05d0, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.793646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:46.892737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 851/1677] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:46 2022] PUT /identity/v3/projects/889434c44c924691803d369b18f228d2/users/f3c88a752cc84d63b25fed2fc46f05d0/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:46.897202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:46.908529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400387f-0a7d-4796-9d04-52cc9681598a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:46.976862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:46.988343 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85eeb1-491f-45aa-9f5d-793bfefee44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:46.989040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85eeb1-491f-45aa-9f5d-793bfefee44e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:46.989332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85eeb1-491f-45aa-9f5d-793bfefee44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:46.989603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85eeb1-491f-45aa-9f5d-793bfefee44e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:46.990654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85eeb1-491f-45aa-9f5d-793bfefee44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:46.992871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85eeb1-491f-45aa-9f5d-793bfefee44e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:47.008070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 827/1678] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:47.009280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:47.023950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949ee4b-7d66-4811-a3fb-16f75100cab3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:47.038640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:47.040065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:47.040476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:47.040761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] PATH_INFO: `/v3/projects/889434c44c924691803d369b18f228d2/users/f3c88a752cc84d63b25fed2fc46f05d0/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:47.044266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889434c44c924691803d369b18f228d2, user_id=f3c88a752cc84d63b25fed2fc46f05d0, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:47.049179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:47.064725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 852/1679] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:47 2022] PUT /identity/v3/projects/889434c44c924691803d369b18f228d2/users/f3c88a752cc84d63b25fed2fc46f05d0/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:47.074752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:47.075083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:47.075373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:47.118941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] MFA Rules not processed for user `f3c88a752cc84d63b25fed2fc46f05d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:47.120558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:47.220607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 828/1680] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:47.236533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:47.238434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:47.322135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd08681-7edc-45e9-a51b-d2e0913b1915 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:47.326149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5e69-6bf3-4c8e-8d7e-af63b7a31459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:47.326789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5e69-6bf3-4c8e-8d7e-af63b7a31459 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:47.327074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5e69-6bf3-4c8e-8d7e-af63b7a31459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:47.327353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5e69-6bf3-4c8e-8d7e-af63b7a31459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:47.429189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5e69-6bf3-4c8e-8d7e-af63b7a31459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:47.431903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5e69-6bf3-4c8e-8d7e-af63b7a31459 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:47.457514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 853/1681] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:48.135344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:48.215653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:49.590634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:49.593827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:49.600477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ba80e-3322-4bf6-9d3b-02bd6ca998ee None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.600916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ba80e-3322-4bf6-9d3b-02bd6ca998ee None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.601051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ba80e-3322-4bf6-9d3b-02bd6ca998ee None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.602802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 854/1682] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:08:49.604694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cba06-625b-4918-b2c5-7b3b4560d8f1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:49.608765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f6f69-fe8f-4ec8-b555-36c69d5c13e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:49.609887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f6f69-fe8f-4ec8-b555-36c69d5c13e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.610197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f6f69-fe8f-4ec8-b555-36c69d5c13e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.610538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f6f69-fe8f-4ec8-b555-36c69d5c13e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.637290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937732-a048-4d70-8e16-199c9b91a3bd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.637573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937732-a048-4d70-8e16-199c9b91a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.637847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937732-a048-4d70-8e16-199c9b91a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.663785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-76937732-a048-4d70-8e16-199c9b91a3bd None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:49.665143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-76937732-a048-4d70-8e16-199c9b91a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:49.671236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f6f69-fe8f-4ec8-b555-36c69d5c13e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:49.673253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f6f69-fe8f-4ec8-b555-36c69d5c13e4 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:49.682661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 829/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:49.731377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 855/1684] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:08:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:49.744691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c28598-6359-4e82-9fa6-6172b5c1560d None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.744983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c28598-6359-4e82-9fa6-6172b5c1560d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.746522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c28598-6359-4e82-9fa6-6172b5c1560d None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.747954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 830/1685] 10.222.0.13 () {54 vars in 961 bytes} [Fri Oct 14 03:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:08:49.754733 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c28598-6359-4e82-9fa6-6172b5c1560d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:49.755969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.756928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.757438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.758244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-71c28598-6359-4e82-9fa6-6172b5c1560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:49.788554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:49.789911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:49.799265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 856/1686] 10.222.0.13 () {58 vars in 1058 bytes} [Fri Oct 14 03:08:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:49.806575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:49.817659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5429c8-e99d-49c3-bc37-1a7aed800089 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:49.822824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:49.825008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.825008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.825008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.832570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:49.833896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c28598-6359-4e82-9fa6-6172b5c1560d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:49.834143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:49.842346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:49.843201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:49.843604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:49.844766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 857/1687] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:49.844898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] PATH_INFO: `/v3/users/ffc19ded49a74261b48bbe7c2a7f1904` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:49.847709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc19ded49a74261b48bbe7c2a7f1904)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:49.849810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:49.863969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:50.038112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:50.051648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc19ded49a74261b48bbe7c2a7f1904'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.058697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc19ded49a74261b48bbe7c2a7f1904'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.059391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc19ded49a74261b48bbe7c2a7f1904'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.151974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc19ded49a74261b48bbe7c2a7f1904'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.166020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-956663a2-d1b9-46c9-9870-96b7c9e33214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc19ded49a74261b48bbe7c2a7f1904'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.172086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 831/1688] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:49 2022] DELETE /identity/v3/users/ffc19ded49a74261b48bbe7c2a7f1904 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:50.397505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:50.409397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850541dc-fa32-4a15-96a4-8d8975f285b5 service placement] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:50.471210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:50.471838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:50.472118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:50.472417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] PATH_INFO: `/v3/projects/8b6e8512548449958d68927e75882932` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:50.473534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6e8512548449958d68927e75882932)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:50.475437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:50.595163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6e8512548449958d68927e75882932', 'request_id': 'req-0fd64905-f498-457b-894f-a9dbcfd49a82'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.601314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6e8512548449958d68927e75882932', 'request_id': 'req-0fd64905-f498-457b-894f-a9dbcfd49a82'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.673918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6e8512548449958d68927e75882932', 'request_id': 'req-0fd64905-f498-457b-894f-a9dbcfd49a82'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.685494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] The token cache is being invalidate because project 8b6e8512548449958d68927e75882932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:50.685792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.686935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:50.689014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 858/1689] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:50 2022] DELETE /identity/v3/projects/8b6e8512548449958d68927e75882932 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:50.694003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5959d-05b7-4c83-ad79-38b92f276cb0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:50.694794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5959d-05b7-4c83-ad79-38b92f276cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:50.695079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5959d-05b7-4c83-ad79-38b92f276cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:50.716507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7cd5959d-05b7-4c83-ad79-38b92f276cb0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:50.717727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7cd5959d-05b7-4c83-ad79-38b92f276cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:50.771837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:50.787284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:50.787382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 832/1690] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:50.795161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:50.795516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:50.795787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:50.817040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:50.818261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:50.827364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 833/1691] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:50.831901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:50.841113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0198d-3652-4561-a13a-aa1861680d80 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:50.845792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:50.846379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:50.846655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:50.847094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:50.847547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:50.847846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:50.849453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:50.852694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd64905-f498-457b-894f-a9dbcfd49a82 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:50.857609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:50.858518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:50.858814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:50.859098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] PATH_INFO: `/v3/users/771c644b3714439eab7a2bd5cc1663f1` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:50.861143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771c644b3714439eab7a2bd5cc1663f1)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:50.861891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 834/1692] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:08:50.863262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:50.865991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:50.876920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeea138-8341-41f4-bde9-bf1b2025da14 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:50.882092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:50.882691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:50.882991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:50.883261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:50.883889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:50.885808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.018167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 835/1693] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:50 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:51.022306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.045379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771c644b3714439eab7a2bd5cc1663f1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:51.053567 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771c644b3714439eab7a2bd5cc1663f1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:51.067480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771c644b3714439eab7a2bd5cc1663f1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:51.068228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771c644b3714439eab7a2bd5cc1663f1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:51.087012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed78db3-52fb-475c-9957-23ae516051d0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.091725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.092327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.092644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.092920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.093582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.095561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.113897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f214d3-3a13-4938-b4d3-4b0cd4268517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771c644b3714439eab7a2bd5cc1663f1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:51.122736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 859/1694] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:50 2022] DELETE /identity/v3/users/771c644b3714439eab7a2bd5cc1663f1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:51.127325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.127618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.127882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.146991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:51.148189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.186187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 836/1695] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:51 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:51.187529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.194479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.209023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:51.215081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5da06-c912-4c02-987d-c175e568f4c5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.239477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 860/1696] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:51.246136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.247553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.309723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.310364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.310632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.310911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.311566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.313377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.325962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 837/1697] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:51.327093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.329282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.338175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8b22-1fa0-4734-9394-f3c1b5e19cdb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.345765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.346544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.346889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.347168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.359078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.361127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.372958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 861/1698] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:51.375791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.385288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ca665-7361-4033-b4df-22b47f731c40 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.390960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.391717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.392172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.392552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418c7aa-4d22-4043-8cf6-3b7a5cb7ca10 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.392666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.393352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.395070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.396617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.397382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.397732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.398279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.399980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.406824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 862/1699] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:51.411041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.422382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126034d6-1064-44dd-8849-a7b295161673 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.427244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.427915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.429290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.429290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] PATH_INFO: `/v3/projects/e83df922b58443f18e24766c97abd49a/users/b1f2add71c5847128db786e0477c0a57/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.445150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83df922b58443f18e24766c97abd49a, user_id=b1f2add71c5847128db786e0477c0a57, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.448071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.467777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.470230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa9dd-1ad0-41d5-b4e4-5bbdcf820696 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.479995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 838/1700] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:51.557731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 863/1701] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:51 2022] PUT /identity/v3/projects/e83df922b58443f18e24766c97abd49a/users/b1f2add71c5847128db786e0477c0a57/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:51.568069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.568360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.568666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.599413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] MFA Rules not processed for user `b1f2add71c5847128db786e0477c0a57`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:51.601474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.675343 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 839/1702] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:51.926424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.926424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5f2db-6750-4517-9e65-c3e91e90a436 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.926424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.926424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.928243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.928243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.928243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.928243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.930004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:51.930004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:51.930004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937fd4c-0e9b-48a2-bf38-f3fec1314ec1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:51.930700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:51.930700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:51.930700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:51.930700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] PATH_INFO: `/v3/projects/1ac35255f322479085253e51c93b25a2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:51.931025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac35255f322479085253e51c93b25a2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:51.931025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:51.955955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 864/1703] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:51 2022] POST /identity/v3/projects => generated 405 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:51.960280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.000586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac35255f322479085253e51c93b25a2', 'request_id': 'req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:52.006323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac35255f322479085253e51c93b25a2', 'request_id': 'req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:52.012782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac35255f322479085253e51c93b25a2', 'request_id': 'req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:52.026383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0b8a0-0050-477e-93a7-07a53bd67f14 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.082207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.082811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.083140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.083509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.084066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.086453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.094785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:52.119288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] The token cache is being invalidate because project 1ac35255f322479085253e51c93b25a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:52.119580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:52.120258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b09a1a10-7a5d-498c-ba1f-a9eb1786e512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:52.121819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 840/1704] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:51 2022] DELETE /identity/v3/projects/1ac35255f322479085253e51c93b25a2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:52.127207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639adb-919e-4ca3-af8c-096e8ffe7096 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.127491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639adb-919e-4ca3-af8c-096e8ffe7096 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.127797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639adb-919e-4ca3-af8c-096e8ffe7096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.149351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-69639adb-919e-4ca3-af8c-096e8ffe7096 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:52.150564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-69639adb-919e-4ca3-af8c-096e8ffe7096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:52.158618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 841/1705] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:52.166201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.166648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.166932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.186842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:52.188681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:52.195710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 865/1706] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:51 2022] POST /identity/v3/users => generated 309 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:52.197082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 842/1707] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:52.197228 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.198652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:52.200994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.211426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0efa3d-6974-4c91-a5a9-2c8d5fcf4f9a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.212041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26df7-a434-43c0-998b-d2d9a97a6d09 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.216527 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.217190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.217377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.217490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.217960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.218075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.218342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.218614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:52.218735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.218981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.219295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.220579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.234571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.234571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 866/1708] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:52.234803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 843/1709] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:08:52.236126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.236378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.246123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030b50b-0c83-476c-99b8-540906fa82ee admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.246277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942b758-7e8e-410a-832b-52a1358ec52a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.251368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.251602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.251965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.252243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.252335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.252547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.252715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.252887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] PATH_INFO: `/v3/projects/f1bda2034b1141478b06fd45600ebfab/users/d88871f67f8a423980407f34278a456d/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.253169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.255192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.268725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bda2034b1141478b06fd45600ebfab, user_id=d88871f67f8a423980407f34278a456d, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.272197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.326888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 844/1710] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:52 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:52.331285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.377728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 867/1711] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:52 2022] PUT /identity/v3/projects/f1bda2034b1141478b06fd45600ebfab/users/d88871f67f8a423980407f34278a456d/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:52.380777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.395695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa7336-a9b8-4966-902c-1389850764a2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.476029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.476813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.477100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.477377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.478434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.479110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbcd17-8a46-4487-abd7-bb13f706267f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.481139 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.485907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.486690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.487073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.487566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.488421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.490258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.508098 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 868/1712] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:52.521344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.538256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f9059-ae20-4f15-a299-bc0378aa8474 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.554419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8487701-048d-4ba5-9fa0-3f87a07d0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.555205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8487701-048d-4ba5-9fa0-3f87a07d0524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.555549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8487701-048d-4ba5-9fa0-3f87a07d0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.555888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8487701-048d-4ba5-9fa0-3f87a07d0524 admin admin] PATH_INFO: `/v3/projects/f1bda2034b1141478b06fd45600ebfab/users/d88871f67f8a423980407f34278a456d/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.558061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8487701-048d-4ba5-9fa0-3f87a07d0524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bda2034b1141478b06fd45600ebfab, user_id=d88871f67f8a423980407f34278a456d, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.561494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8487701-048d-4ba5-9fa0-3f87a07d0524 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.572456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 869/1713] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:52 2022] PUT /identity/v3/projects/f1bda2034b1141478b06fd45600ebfab/users/d88871f67f8a423980407f34278a456d/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:52.585442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.590226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.590226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.592629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 845/1714] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:52 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:52.596628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.608815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb08a2-4867-4a18-96fc-1c1b4fd13e11 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.622201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] MFA Rules not processed for user `d88871f67f8a423980407f34278a456d`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:52.622201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:52.669667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.670272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.670609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.670815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.671558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.673909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.684464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 846/1715] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:52.689465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.691316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 870/1716] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:52.701293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591dc3-de9f-4ff8-ab57-b4535f8c2f4e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.703572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.705266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:52.706628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.707244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.707668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.707974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.708946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.710588 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.725656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 847/1717] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:52.726742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:52.737884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341322-52ff-4fc3-88c9-8f1422f5bd12 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.742806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.743470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.743752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.744033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] PATH_INFO: `/v3/projects/473180f95cdd4a30aa7444a7d6b1bbc3/users/f592adc30a7746bd8e7524b33eeb9936/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.769388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473180f95cdd4a30aa7444a7d6b1bbc3, user_id=f592adc30a7746bd8e7524b33eeb9936, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.769388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.772515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca278d8-ad7e-4293-966e-7b0ca970c53b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:52.776332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73387-6d84-46b3-a0d6-805f4c5dff6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:52.776994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73387-6d84-46b3-a0d6-805f4c5dff6e service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.777281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73387-6d84-46b3-a0d6-805f4c5dff6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.777560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73387-6d84-46b3-a0d6-805f4c5dff6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.787498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e73387-6d84-46b3-a0d6-805f4c5dff6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:52.789170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e73387-6d84-46b3-a0d6-805f4c5dff6e service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:52.799352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 871/1718] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:52.862417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 848/1719] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:52 2022] PUT /identity/v3/projects/473180f95cdd4a30aa7444a7d6b1bbc3/users/f592adc30a7746bd8e7524b33eeb9936/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:52.874460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:52.874784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:52.875086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:52.907889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] MFA Rules not processed for user `f592adc30a7746bd8e7524b33eeb9936`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:52.909928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:52.975952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 872/1720] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:53.057843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:53.058413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:53.124129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d87f7-9faf-4cdf-b024-1ea15733f230 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:53.127967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f377f-d93f-40cf-a0ec-6bb5e072606c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:53.132528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f377f-d93f-40cf-a0ec-6bb5e072606c service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:53.132528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f377f-d93f-40cf-a0ec-6bb5e072606c service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:53.132528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f377f-d93f-40cf-a0ec-6bb5e072606c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:53.132813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4642ed-fb03-47c9-927d-96b5d5a86f99 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:53.134147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:53.134771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:53.135099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:53.135376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] PATH_INFO: `/v3/users/b1f2add71c5847128db786e0477c0a57` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:53.136512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f2add71c5847128db786e0477c0a57)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:53.137460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f377f-d93f-40cf-a0ec-6bb5e072606c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:53.138511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:53.138932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f377f-d93f-40cf-a0ec-6bb5e072606c service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:53.148412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 849/1721] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:53.313383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f2add71c5847128db786e0477c0a57'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:53.320348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f2add71c5847128db786e0477c0a57'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:53.330099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:53.335248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f2add71c5847128db786e0477c0a57'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:53.337140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f2add71c5847128db786e0477c0a57'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:53.405712 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f2add71c5847128db786e0477c0a57'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:53.412633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 873/1722] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:53 2022] DELETE /identity/v3/users/b1f2add71c5847128db786e0477c0a57 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:53.417182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:53.417500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:53.417792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:53.437070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:53.438819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:53.502750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 850/1723] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:53.514276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:53.516505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:53.575402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c768583-1712-4b7e-a386-7e06624cf762 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:53.579836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:53.580477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:53.580762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:53.581295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:53.606577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:53.608178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:53.623684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 874/1724] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:54.182425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:54.338282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:54.339732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:54.357186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92d3be-4c3f-475f-b1c2-07fb3822179a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:54.362714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:54.363808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:54.363808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:54.363975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] PATH_INFO: `/v3/projects/e83df922b58443f18e24766c97abd49a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:54.365068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83df922b58443f18e24766c97abd49a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:54.366985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:54.491366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83df922b58443f18e24766c97abd49a', 'request_id': 'req-e18bf723-88a5-4613-8f56-d2145b582984'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:54.497019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83df922b58443f18e24766c97abd49a', 'request_id': 'req-e18bf723-88a5-4613-8f56-d2145b582984'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:54.506390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83df922b58443f18e24766c97abd49a', 'request_id': 'req-e18bf723-88a5-4613-8f56-d2145b582984'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:54.607881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] The token cache is being invalidate because project e83df922b58443f18e24766c97abd49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:54.608180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:54.608867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:54.610979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 851/1725] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:54 2022] DELETE /identity/v3/projects/e83df922b58443f18e24766c97abd49a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:54.625556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:54.626577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688b45b-38f3-4cb9-9ba5-f2b5f5c0f076 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:54.688982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:54.689620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:54.689897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:54.690169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] PATH_INFO: `/v3/users/d88871f67f8a423980407f34278a456d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:54.691274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88871f67f8a423980407f34278a456d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:54.693315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:54.719416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:54.988781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88871f67f8a423980407f34278a456d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:54.995952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88871f67f8a423980407f34278a456d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.009847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88871f67f8a423980407f34278a456d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.010566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88871f67f8a423980407f34278a456d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.139809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dbd641fa-9fcc-4f58-b420-a73e94467e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88871f67f8a423980407f34278a456d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.147050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 875/1726] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:54 2022] DELETE /identity/v3/users/d88871f67f8a423980407f34278a456d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:55.547450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:55.549991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:55.562795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf723-88a5-4613-8f56-d2145b582984 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:55.619378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:55.620009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:55.620287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:55.620609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] PATH_INFO: `/v3/projects/f1bda2034b1141478b06fd45600ebfab` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:55.621709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bda2034b1141478b06fd45600ebfab)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:55.623681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:55.719507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bda2034b1141478b06fd45600ebfab', 'request_id': 'req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.724888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:55.726915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bda2034b1141478b06fd45600ebfab', 'request_id': 'req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.733203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bda2034b1141478b06fd45600ebfab', 'request_id': 'req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.814351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=1,keystone:DELETE=12,keystone:SELECT=87 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:55.818773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] The token cache is being invalidate because project f1bda2034b1141478b06fd45600ebfab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:55.819303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.819711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e1584ff6-3319-4f1d-9526-37dc1cd43bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:55.821288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 852/1727] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:55 2022] DELETE /identity/v3/projects/f1bda2034b1141478b06fd45600ebfab => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:55.826048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:55.826329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:55.826601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:55.846759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:55.847957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:55.907030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 876/1728] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:55.914756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:55.915109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:55.915446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:55.935808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:55.936958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:55.947593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 853/1729] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:55.951504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:55.960665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d463f7-117c-4dbf-bc2c-827ffaa42d26 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:55.965285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:55.965918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:55.966200 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:55.966474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:55.967135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:55.967419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:55.969613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:55.981747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 877/1730] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:08:55.986689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:55.996854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c8de8-3e9c-44b5-abc8-076c549101fd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.001904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.003057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.003338 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.003876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.004552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.006495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.116173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 854/1731] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:55 2022] POST /identity/v3/projects => generated 363 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:56.120171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.131488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106194ec-c27c-4d3b-a814-d21a8ee189bc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.205753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.206542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.206819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.207088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.207720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.209654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.345982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 878/1732] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:56 2022] POST /identity/v3/users => generated 282 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:56.347092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.348900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:56.352909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.363128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899b5fb-ccb8-46ad-8bd1-5eb20721de1e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.364575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c9da6-a669-40f6-8fea-74c8bd1389d9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.370233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.375627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.376190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.376409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.376409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] PATH_INFO: `/v3/users/c3315df6868b471983c34f2dcb71bc8f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.376580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.376580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.376580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.376787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3315df6868b471983c34f2dcb71bc8f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.376883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.376967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.377055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.387745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 879/1733] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:56.392566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.403086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04499c-7af0-46b1-ab38-ec4c71b582c4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.408672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.409366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.409740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.410084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.410795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.412478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.422775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 880/1734] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:56.426428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.435733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325271e4-6351-4ad8-9602-39b908c45238 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.440936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b80a75-dfe4-4008-b91d-4a72ecfdbddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.441568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80a75-dfe4-4008-b91d-4a72ecfdbddb admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.441849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80a75-dfe4-4008-b91d-4a72ecfdbddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.442123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80a75-dfe4-4008-b91d-4a72ecfdbddb admin admin] PATH_INFO: `/v3/projects/9ba608cfce474acdb3570869152dd7cb/users/09fd92f748734f9fa458a212ac25da27/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.457421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80a75-dfe4-4008-b91d-4a72ecfdbddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba608cfce474acdb3570869152dd7cb, user_id=09fd92f748734f9fa458a212ac25da27, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.459996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80a75-dfe4-4008-b91d-4a72ecfdbddb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.536651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 881/1735] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:56 2022] PUT /identity/v3/projects/9ba608cfce474acdb3570869152dd7cb/users/09fd92f748734f9fa458a212ac25da27/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:56.546761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.547045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.547318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.572656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3315df6868b471983c34f2dcb71bc8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:56.575651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] MFA Rules not processed for user `09fd92f748734f9fa458a212ac25da27`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:56.577107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:56.580433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3315df6868b471983c34f2dcb71bc8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:56.581370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3315df6868b471983c34f2dcb71bc8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:56.593230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:56.640751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 882/1736] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:56.645044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.646341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:56.679417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3315df6868b471983c34f2dcb71bc8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:56.680070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:56.708838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef586822-f6c3-4226-be60-a1958af62528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3315df6868b471983c34f2dcb71bc8f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:56.726966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d91fd2-bb0e-44cb-9668-5d0a754560b9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.727082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 855/1737] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:56 2022] DELETE /identity/v3/users/c3315df6868b471983c34f2dcb71bc8f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:56.731156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.732222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.732897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.754713 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:56.755872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:56.787216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.787930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.788281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.788650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.789287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.791357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:56.823598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 856/1738] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:56.834401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.835896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:56.899885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 883/1739] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:56 2022] POST /identity/v3/projects => generated 363 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:56.900924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:56.901154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193f86-243e-495a-b532-01c6dbf35f6c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.951153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.951992 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.952277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.953164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.965057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093f61a-549b-4ef5-b6a9-3d04234f34d0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:56.971457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:56.972860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:56.972860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:56.973090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:56.973693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:56.976083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.014210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.016241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.025641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 857/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:57.051511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 884/1741] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:56 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:08:57.052721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.063485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb45882-db9d-4670-98de-230d454bbc3b service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.068721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.070593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.070593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.070593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.070593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.072060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.083129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 858/1742] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:08:57.087661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.099160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5514cc-a4b6-45bf-9ea4-2330851d962a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.103954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.104647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.104930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.105263 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] PATH_INFO: `/v3/projects/4a543505951c4180989d7fd8c465a927/users/059260e16da140ba8b933dc73e9e71e1/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.121062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a543505951c4180989d7fd8c465a927, user_id=059260e16da140ba8b933dc73e9e71e1, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.123760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.237952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 885/1743] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:57 2022] PUT /identity/v3/projects/4a543505951c4180989d7fd8c465a927/users/059260e16da140ba8b933dc73e9e71e1/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:57.242985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.255939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcc1e-52b0-4881-8810-b9fd1ed1424b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.286096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:57.314929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:57.332790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744c62d-be18-4740-b514-eb0bc802959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.333467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744c62d-be18-4740-b514-eb0bc802959f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.333893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744c62d-be18-4740-b514-eb0bc802959f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.334775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744c62d-be18-4740-b514-eb0bc802959f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.334993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744c62d-be18-4740-b514-eb0bc802959f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.336630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744c62d-be18-4740-b514-eb0bc802959f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.352637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 859/1744] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:08:57.356667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.367061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01796d6e-ec3c-414d-958b-142c37f611b2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.371792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.372486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.372766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.373041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] PATH_INFO: `/v3/projects/4a543505951c4180989d7fd8c465a927/users/059260e16da140ba8b933dc73e9e71e1/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.375577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a543505951c4180989d7fd8c465a927, user_id=059260e16da140ba8b933dc73e9e71e1, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.378248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.389016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 886/1745] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:08:57 2022] PUT /identity/v3/projects/4a543505951c4180989d7fd8c465a927/users/059260e16da140ba8b933dc73e9e71e1/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:57.401313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.402880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.402880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.429507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] MFA Rules not processed for user `059260e16da140ba8b933dc73e9e71e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:57.431567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:57.460445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.460445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:57.510764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 860/1746] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:57.522767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.524646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:57.537729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60990-edb6-4e19-a3f5-a104c300a31f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.543710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.544436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.544726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.545001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] PATH_INFO: `/v3/projects/11771a0ff6054fee9e94a3bda6904664` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.546933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11771a0ff6054fee9e94a3bda6904664)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.548912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.581585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23868f-b44e-4162-a712-5dc844b6fc0f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.585141 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.585750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.586030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.586301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.595583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.597044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:57.606553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 861/1747] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:57.686030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11771a0ff6054fee9e94a3bda6904664', 'request_id': 'req-6712fb8a-4680-4856-b4dd-c8f859db68f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:57.692982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11771a0ff6054fee9e94a3bda6904664', 'request_id': 'req-6712fb8a-4680-4856-b4dd-c8f859db68f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:57.791335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11771a0ff6054fee9e94a3bda6904664', 'request_id': 'req-6712fb8a-4680-4856-b4dd-c8f859db68f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:57.803414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] The token cache is being invalidate because project 11771a0ff6054fee9e94a3bda6904664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:57.803709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:57.804376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:57.805911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 887/1748] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:57 2022] DELETE /identity/v3/projects/11771a0ff6054fee9e94a3bda6904664 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:57.810030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:57.822773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ac3bb-7aef-4d35-98bb-35484806e326 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:57.891107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:57.902946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:57.902946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:57.902946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] PATH_INFO: `/v3/users/7fdffdddd06644ac84091aa316e1b15e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:57.902946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fdffdddd06644ac84091aa316e1b15e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:57.902946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:58.010808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:58.036359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:58.038989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:58.052878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712fb8a-4680-4856-b4dd-c8f859db68f4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:58.057690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:58.058323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:58.067163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:58.067163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] PATH_INFO: `/v3/users/b7bd73ef4d5142aba2d31e2fa39a9da1` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:58.067163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7bd73ef4d5142aba2d31e2fa39a9da1)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:58.067163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:58.087204 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fdffdddd06644ac84091aa316e1b15e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.090741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:58.097173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fdffdddd06644ac84091aa316e1b15e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.098360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fdffdddd06644ac84091aa316e1b15e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.159013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fdffdddd06644ac84091aa316e1b15e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.173028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c3667d6f-c6f8-495c-bd71-8d078dee83a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fdffdddd06644ac84091aa316e1b15e'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.179018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 862/1749] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:57 2022] DELETE /identity/v3/users/7fdffdddd06644ac84091aa316e1b15e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:58.251460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7bd73ef4d5142aba2d31e2fa39a9da1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.258699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7bd73ef4d5142aba2d31e2fa39a9da1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.274483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7bd73ef4d5142aba2d31e2fa39a9da1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.275319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7bd73ef4d5142aba2d31e2fa39a9da1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.353170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7bd73ef4d5142aba2d31e2fa39a9da1'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.369538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 888/1750] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:58 2022] DELETE /identity/v3/users/b7bd73ef4d5142aba2d31e2fa39a9da1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:58.375090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:58.375388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:58.377019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:58.403965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:58.405523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:58.489962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 863/1751] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:58.508601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:58.508601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:58.588281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:58.592107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc799d-5381-4843-82d0-ced778b9c753 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:58.597179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:58.597179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:58.597502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:58.597779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:58.607053 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:58.608526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:58.620762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 889/1752] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:08:58.621693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:58.623266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:58.635931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126d816-4ba5-43c3-b707-9608ce505c38 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:58.642133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:58.642813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:58.643056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:58.643493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] PATH_INFO: `/v3/users/09fd92f748734f9fa458a212ac25da27` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:58.644738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fd92f748734f9fa458a212ac25da27)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:58.646734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:58.658499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:58.660927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:58.683067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975efa93-1f73-4289-941b-0691b4bf7bad service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:58.691031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:58.691844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:58.692222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:58.692667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] PATH_INFO: `/v3/projects/2fd61a4386d9485b9d627dbd12ce02d6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:58.694135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd61a4386d9485b9d627dbd12ce02d6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:58.696141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:58.874728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:58.889628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd61a4386d9485b9d627dbd12ce02d6', 'request_id': 'req-178577f8-7d4a-43f9-bf20-12a1224ddfb2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.893476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fd92f748734f9fa458a212ac25da27'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.896948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd61a4386d9485b9d627dbd12ce02d6', 'request_id': 'req-178577f8-7d4a-43f9-bf20-12a1224ddfb2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.902558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fd92f748734f9fa458a212ac25da27'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.903345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fd92f748734f9fa458a212ac25da27'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.957087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd61a4386d9485b9d627dbd12ce02d6', 'request_id': 'req-178577f8-7d4a-43f9-bf20-12a1224ddfb2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.968487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] The token cache is being invalidate because project 2fd61a4386d9485b9d627dbd12ce02d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:58.968786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.969474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:58.971119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 890/1753] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:58 2022] DELETE /identity/v3/projects/2fd61a4386d9485b9d627dbd12ce02d6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:58.976773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:58.976773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.019558 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fd92f748734f9fa458a212ac25da27'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.032689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-056dc605-2191-4d2c-9f6c-fe594c5aaad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fd92f748734f9fa458a212ac25da27'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.041823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 864/1754] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:58 2022] DELETE /identity/v3/users/09fd92f748734f9fa458a212ac25da27 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:59.043551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.044363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.045082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.045598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178577f8-7d4a-43f9-bf20-12a1224ddfb2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:59.065433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:59.066621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.102780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:59.103470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.103800 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.104028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] PATH_INFO: `/v3/users/f3c88a752cc84d63b25fed2fc46f05d0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.105503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c88a752cc84d63b25fed2fc46f05d0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:59.109338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:59.123175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:59.141495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 865/1755] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:08:59.142350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:59.143639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.156268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6817f-84e5-4be5-bdde-c28cfea78d8f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:59.161514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:59.162137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.162422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.162699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] PATH_INFO: `/v3/projects/80c066787f8a40328409e4a6201fdc71` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.163809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c066787f8a40328409e4a6201fdc71)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:59.165798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:59.329012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:59.342267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c88a752cc84d63b25fed2fc46f05d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.343603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c066787f8a40328409e4a6201fdc71', 'request_id': 'req-12343588-bc6d-415d-86e0-7675fd1a6a00'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.348923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c066787f8a40328409e4a6201fdc71', 'request_id': 'req-12343588-bc6d-415d-86e0-7675fd1a6a00'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.349595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c88a752cc84d63b25fed2fc46f05d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.355741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c066787f8a40328409e4a6201fdc71', 'request_id': 'req-12343588-bc6d-415d-86e0-7675fd1a6a00'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.362925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c88a752cc84d63b25fed2fc46f05d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.366585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c88a752cc84d63b25fed2fc46f05d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.410390 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:59.441681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] The token cache is being invalidate because project 80c066787f8a40328409e4a6201fdc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:08:59.442004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.442657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.444179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 866/1756] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:08:59 2022] DELETE /identity/v3/projects/80c066787f8a40328409e4a6201fdc71 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:08:59.445059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:59.446412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.504826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343588-bc6d-415d-86e0-7675fd1a6a00 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:59.508444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:59.509044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.509327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.509599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.511317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.551001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-62c5a0bb-d0e5-4416-aee7-c6285090ab00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c88a752cc84d63b25fed2fc46f05d0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:08:59.557782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 891/1757] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:08:58 2022] DELETE /identity/v3/users/f3c88a752cc84d63b25fed2fc46f05d0 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:08:59.560786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.560786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.560786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.576772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:59.578543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b20e6d-615d-44bd-a11e-7fab6669e95f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:59.582349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:59.583834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.605722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 867/1758] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:08:59.695420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 892/1759] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:59.703086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.703617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.703617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.720632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:59.731542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:08:59.733006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:08:59.742879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 868/1760] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:08:59.747186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:59.758051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b8afd-25ba-4a3d-ad8e-dc58ee8ab77d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:59.763548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:59.764163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.764460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.764735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.766713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:08:59.767175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:59.768842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:59.781682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 893/1761] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:08:59.785936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:59.795249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dd6eb-1e44-4dfc-93e3-1f4ac561be0d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:08:59.800354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:08:59.801196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:08:59.801513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:08:59.801683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:08:59.802319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:08:59.804235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:08:59.859033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:08:59.961065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 869/1762] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:08:59 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:08:59.969496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:08:59.980382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d350dd-66fc-438d-a05a-a79eb6c5903f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.049622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.050318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.050871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.050871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.051403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.053795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.160417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 894/1763] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:08:59 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:00.162068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.172529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95839e-e565-4eae-938e-1dd7f5360e99 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.177647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.187889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.192887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.193143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.193143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.193143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.193143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.194611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.203773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46aee-7283-4240-8c3d-005b01692bb6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.208988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 870/1764] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:00.209967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.211737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.217359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.218076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.218364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.218647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] PATH_INFO: `/v3/projects/9ba608cfce474acdb3570869152dd7cb` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.220296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba608cfce474acdb3570869152dd7cb)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.222587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.229741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5115a5-203e-4053-8c70-f716103f19b7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.231208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.231839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.232123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.232414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] PATH_INFO: `/v3/projects/889434c44c924691803d369b18f228d2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.233592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889434c44c924691803d369b18f228d2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.235524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.333138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba608cfce474acdb3570869152dd7cb', 'request_id': 'req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.340169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba608cfce474acdb3570869152dd7cb', 'request_id': 'req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.354566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889434c44c924691803d369b18f228d2', 'request_id': 'req-8721febc-b2d3-40c4-8d92-e94196e348b4'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.361486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889434c44c924691803d369b18f228d2', 'request_id': 'req-8721febc-b2d3-40c4-8d92-e94196e348b4'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.368544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889434c44c924691803d369b18f228d2', 'request_id': 'req-8721febc-b2d3-40c4-8d92-e94196e348b4'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.408145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba608cfce474acdb3570869152dd7cb', 'request_id': 'req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.419422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] The token cache is being invalidate because project 9ba608cfce474acdb3570869152dd7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:00.419705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.420336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.421863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 895/1765] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:00 2022] DELETE /identity/v3/projects/9ba608cfce474acdb3570869152dd7cb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:00.425655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.426925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.498518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] The token cache is being invalidate because project 889434c44c924691803d369b18f228d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:00.498518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.498518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.498518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 871/1766] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:00 2022] DELETE /identity/v3/projects/889434c44c924691803d369b18f228d2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:00.498518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.499874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.500524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e5f07-474f-4fe1-9d23-7b44e863b8c7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.558853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:00.561506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721febc-b2d3-40c4-8d92-e94196e348b4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.566309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fcb4-d181-4cac-809c-1ecb22732035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.566309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fcb4-d181-4cac-809c-1ecb22732035 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.566309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fcb4-d181-4cac-809c-1ecb22732035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.566309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fcb4-d181-4cac-809c-1ecb22732035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.566717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.566810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fcb4-d181-4cac-809c-1ecb22732035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.567325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.567609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.567879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] PATH_INFO: `/v3/users/059260e16da140ba8b933dc73e9e71e1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.568523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fcb4-d181-4cac-809c-1ecb22732035 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.569050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059260e16da140ba8b933dc73e9e71e1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.570947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.579833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 896/1767] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:00.581324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.581618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.581896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.602560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:00.603778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.612482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 897/1768] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:00.613234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.614671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.626903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb584-bd42-4670-ad05-36462aec466b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.631668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02474b0-7020-47bf-a169-1523422fc1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.632341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02474b0-7020-47bf-a169-1523422fc1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.632653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02474b0-7020-47bf-a169-1523422fc1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.635109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02474b0-7020-47bf-a169-1523422fc1a9 admin admin] PATH_INFO: `/v3/projects/39e84d2bb3924dd6a26bddf1349debe3/users/59251eeac2754429961e3720bf0c4ba9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.648636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02474b0-7020-47bf-a169-1523422fc1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e84d2bb3924dd6a26bddf1349debe3, user_id=59251eeac2754429961e3720bf0c4ba9, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.651417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02474b0-7020-47bf-a169-1523422fc1a9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.734266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 898/1769] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:00 2022] PUT /identity/v3/projects/39e84d2bb3924dd6a26bddf1349debe3/users/59251eeac2754429961e3720bf0c4ba9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:00.735537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deebc3d-97d4-4d9e-afba-8861fbd8757c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.735822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deebc3d-97d4-4d9e-afba-8861fbd8757c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.738516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deebc3d-97d4-4d9e-afba-8861fbd8757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.755458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-0deebc3d-97d4-4d9e-afba-8861fbd8757c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:00.756770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0deebc3d-97d4-4d9e-afba-8861fbd8757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.805509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059260e16da140ba8b933dc73e9e71e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.814409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059260e16da140ba8b933dc73e9e71e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.815096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059260e16da140ba8b933dc73e9e71e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.819919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 899/1770] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:00.821313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.821594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.821867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.851015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] MFA Rules not processed for user `59251eeac2754429961e3720bf0c4ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:00.852249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.918747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 900/1771] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:00.919612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.931869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4720f0-a4cc-4926-9149-c64866542ae6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:00.935954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059260e16da140ba8b933dc73e9e71e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.937278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:00.937990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:00.938352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:00.938690 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:00.939410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:09:00.939783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:00.942075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:00.950747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059260e16da140ba8b933dc73e9e71e1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:00.955019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 901/1772] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:09:00.957292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:00.958831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:00.963195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 872/1773] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:00 2022] DELETE /identity/v3/users/059260e16da140ba8b933dc73e9e71e1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:00.967974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.106181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173756d7-2f8b-4487-aeec-b5e1dbef2c51 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.107574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b453b-b92c-4f20-8928-5fe47e11591b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.110493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:01.114849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.115538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.116307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.116307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.117165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.119199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.205117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.206245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.214624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.214624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.230952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 873/1774] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:00 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:01.235641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.318449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0f1ad-1d88-4def-b1e9-a84788f2cf61 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.325243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.326267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.326868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.327950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.328819 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.329332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.331083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.332045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.359477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 902/1775] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:01.473025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 874/1776] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:01 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:01.475131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.487598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b2412-b223-4d68-af80-85d64cc1d5d1 service glance] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.496790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.497653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.498197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.506535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.506535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.506535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.509601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.511513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:01.528813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 903/1777] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:01.530299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.549968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a19bb-04d5-4521-affa-7871ad2889ca admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.555463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.556074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.556360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.556687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] PATH_INFO: `/v3/projects/4a543505951c4180989d7fd8c465a927` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.557825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a543505951c4180989d7fd8c465a927)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.559856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.563410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aff1d6-7bec-4efd-bf59-ff180202c861 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.569603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.569603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.569603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.569603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.570235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.572434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.587662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 904/1778] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:01.588870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.604349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6d90-be98-4629-aa65-36b34021d3ae admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.609892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2d21-2703-4aca-9f00-cedbc3136e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.610558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2d21-2703-4aca-9f00-cedbc3136e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.610841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2d21-2703-4aca-9f00-cedbc3136e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.611120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2d21-2703-4aca-9f00-cedbc3136e15 admin admin] PATH_INFO: `/v3/projects/edb6b87dc2ec47678d7fb4659b07621b/users/7067e540ef484399bd21169fade3a098/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.630624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2d21-2703-4aca-9f00-cedbc3136e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb6b87dc2ec47678d7fb4659b07621b, user_id=7067e540ef484399bd21169fade3a098, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.633582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2d21-2703-4aca-9f00-cedbc3136e15 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.721064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 905/1779] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:01 2022] PUT /identity/v3/projects/edb6b87dc2ec47678d7fb4659b07621b/users/7067e540ef484399bd21169fade3a098/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:01.728598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a543505951c4180989d7fd8c465a927', 'request_id': 'req-d18584cd-cd04-4a20-8bc6-47641e8a2121'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:01.732186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.732508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.732789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.735154 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a543505951c4180989d7fd8c465a927', 'request_id': 'req-d18584cd-cd04-4a20-8bc6-47641e8a2121'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:01.738798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:01.742089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a543505951c4180989d7fd8c465a927', 'request_id': 'req-d18584cd-cd04-4a20-8bc6-47641e8a2121'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:01.765177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] MFA Rules not processed for user `7067e540ef484399bd21169fade3a098`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:01.766457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:01.837139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 906/1780] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:01.847691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:01.866783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] The token cache is being invalidate because project 4a543505951c4180989d7fd8c465a927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:01.866783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:01.869042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d18584cd-cd04-4a20-8bc6-47641e8a2121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:01.870909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 875/1781] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:01 2022] DELETE /identity/v3/projects/4a543505951c4180989d7fd8c465a927 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:01.877957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1769-be28-4449-b3a6-fa1f6e77690d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.878475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1769-be28-4449-b3a6-fa1f6e77690d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.878761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1769-be28-4449-b3a6-fa1f6e77690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.900169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d9ac1769-be28-4449-b3a6-fa1f6e77690d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:01.901938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d9ac1769-be28-4449-b3a6-fa1f6e77690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:01.913333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d91ca-40e9-49d7-a8bd-094b406425f5 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:01.918128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:01.918743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.919026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.919307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:01.919941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:01.922457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:01.971652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 876/1782] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:09:01.979467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:01.979763 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:01.980040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.000747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:02.001963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:02.013329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 877/1783] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:02.019302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.024324 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7a1ae-66c6-4c61-835d-025c6757579a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.029187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.029775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.030053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.030927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.031567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:09:02.031870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.033489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.053908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 878/1784] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:09:02.054106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 907/1785] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:01 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:02.054223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.055037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.055422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:02.073227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df7c48-6a12-4a97-96bb-611d50ebb2a6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.124120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ad43-c9ce-4754-8486-f39bbb7fa89f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.129731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.130352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.130688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.130968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.131601 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.133613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.144342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.145052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.145928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.145928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.146555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.148545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.199472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:02.238929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 908/1786] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:02.246309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.271612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 879/1787] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:02.274346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.285462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfe59c-3823-4e4e-9b90-cbb454a57620 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.321543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bad4af-f2ee-437f-aded-2e77b6320be9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.328533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.329185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.329467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.329761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.331402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.333211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.374634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.375281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.375522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.375797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.376612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.378210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.392438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 880/1788] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:02.394694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.404531 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304821fe-8e61-491e-85de-e79ad387b76f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.409237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.410245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.410245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.410455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.411180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.412916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.422772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 881/1789] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:02.428342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.438049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd7c73-4e19-4d12-a649-8ae823d49241 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.442600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb7fb6-dd1c-4a67-9d3b-bb4662046b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.443201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb7fb6-dd1c-4a67-9d3b-bb4662046b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.443477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb7fb6-dd1c-4a67-9d3b-bb4662046b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.443747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb7fb6-dd1c-4a67-9d3b-bb4662046b59 admin admin] PATH_INFO: `/v3/projects/5aca67ab0a154725a23f9f677df912fc/users/bc9bf4f512ca47bab7a534b8e89e9cfd/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.458740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb7fb6-dd1c-4a67-9d3b-bb4662046b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aca67ab0a154725a23f9f677df912fc, user_id=bc9bf4f512ca47bab7a534b8e89e9cfd, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.461332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb7fb6-dd1c-4a67-9d3b-bb4662046b59 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.466142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 909/1790] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:02.472803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.482857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744127e7-9ff2-4c49-9417-255c67431905 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.487782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.488407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.488705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.488976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.489623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.491251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.506264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 910/1791] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:02.507156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.517523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafdf09-e51f-4b4a-83c5-98551b58e9f1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.522501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.523238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.523525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.523789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.524585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.526189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.536127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 911/1792] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:02.540159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.550971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ab71-0ffe-4dbf-a1b7-50a80b4ddd79 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.555702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496b769-f27e-4355-a07b-d163d27a2699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.560451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496b769-f27e-4355-a07b-d163d27a2699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.560451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496b769-f27e-4355-a07b-d163d27a2699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.560451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496b769-f27e-4355-a07b-d163d27a2699 admin admin] PATH_INFO: `/v3/projects/2672469044ae418186a01036e653f609/users/73ae4a16f6004c1ba3ac3ee19def9399/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.573261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496b769-f27e-4355-a07b-d163d27a2699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2672469044ae418186a01036e653f609, user_id=73ae4a16f6004c1ba3ac3ee19def9399, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.575917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496b769-f27e-4355-a07b-d163d27a2699 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.585823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 882/1793] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:02 2022] PUT /identity/v3/projects/5aca67ab0a154725a23f9f677df912fc/users/bc9bf4f512ca47bab7a534b8e89e9cfd/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:02.596316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56453-0151-4201-b898-aca98a097819 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.596639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56453-0151-4201-b898-aca98a097819 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.596942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b56453-0151-4201-b898-aca98a097819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.626316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b7b56453-0151-4201-b898-aca98a097819 None None] MFA Rules not processed for user `bc9bf4f512ca47bab7a534b8e89e9cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:02.627528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b7b56453-0151-4201-b898-aca98a097819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:02.642491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 912/1794] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:02 2022] PUT /identity/v3/projects/2672469044ae418186a01036e653f609/users/73ae4a16f6004c1ba3ac3ee19def9399/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:02.647566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.647857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.648131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.668249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:02.669418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:02.694618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 883/1795] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:09:02.698942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56453-0151-4201-b898-aca98a097819 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.732151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 913/1796] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:09:02.741919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.743294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:02.754774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:02.760507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b56453-0151-4201-b898-aca98a097819 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.765724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.766329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.766608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.766881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.767515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.769550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.803585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190eefa7-c2bf-4b29-a072-fd46c7fd3709 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.807626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.809422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.809422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.809422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.820350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.821791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:02.829010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 884/1797] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:02.833244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:02.835885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 914/1798] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:09:02.898613 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc6b2c-8fce-4697-8381-36c359b40a4b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:02.903653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:02.904265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:02.904592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:02.905074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:02.905662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:02.907614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:03.046731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:03.055127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 885/1799] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:02 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:03.059334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:03.070114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd418a-ecdb-40f6-9cbd-100cb107e9bf service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:03.075113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:03.076013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:03.076615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:03.077128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:03.078043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:03.079883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:03.093040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 915/1800] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:03.097360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:03.111138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b317b-8192-4ed5-a0bf-38f11230a7a9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:03.116188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:03.117217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:03.117645 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:03.117870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] PATH_INFO: `/v3/projects/f414b9c276a9408a85c0424299b881b4/users/7f6f1cbc4a84461b9dda14c6983f725b/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:03.148623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f414b9c276a9408a85c0424299b881b4, user_id=7f6f1cbc4a84461b9dda14c6983f725b, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:03.151428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:03.243439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:03.251015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 886/1801] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:03 2022] PUT /identity/v3/projects/f414b9c276a9408a85c0424299b881b4/users/7f6f1cbc4a84461b9dda14c6983f725b/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:03.254989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:03.265533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea0dd9-8dfd-4799-81df-3f84cf0beb17 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:03.333731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a76e8-9011-4e38-9461-64823a218ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:03.335049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a76e8-9011-4e38-9461-64823a218ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:03.335386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a76e8-9011-4e38-9461-64823a218ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:03.335657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a76e8-9011-4e38-9461-64823a218ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:03.336651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a76e8-9011-4e38-9461-64823a218ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:03.338450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a76e8-9011-4e38-9461-64823a218ba0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:03.351789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 916/1802] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:03.355673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:03.368644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f325a-85c2-43af-81b7-d66e2b6e8f22 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:03.373810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:03.374661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:03.374969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:03.375240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] PATH_INFO: `/v3/projects/f414b9c276a9408a85c0424299b881b4/users/7f6f1cbc4a84461b9dda14c6983f725b/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:03.377169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f414b9c276a9408a85c0424299b881b4, user_id=7f6f1cbc4a84461b9dda14c6983f725b, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:03.380035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:03.391115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 887/1803] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:03 2022] PUT /identity/v3/projects/f414b9c276a9408a85c0424299b881b4/users/7f6f1cbc4a84461b9dda14c6983f725b/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:03.402632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df9c8b-4334-4e26-b83d-6e068b5b3329 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:03.402906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df9c8b-4334-4e26-b83d-6e068b5b3329 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:03.403175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df9c8b-4334-4e26-b83d-6e068b5b3329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:03.433227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f2df9c8b-4334-4e26-b83d-6e068b5b3329 None None] MFA Rules not processed for user `7f6f1cbc4a84461b9dda14c6983f725b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:03.434441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f2df9c8b-4334-4e26-b83d-6e068b5b3329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:03.502145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:03.519184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 917/1804] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:09:03.527425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:03.529491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:03.659325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0013a83-f785-4816-ad3d-bfbe27f32b11 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:03.669894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:03.669894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:03.669894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:03.669894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:03.670323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:03.730930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:03.732439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:03.741907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 888/1805] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:03.833406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.238805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.407952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.450166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:04.450819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:04.451097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:04.488959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] MFA Rules not processed for user `73ae4a16f6004c1ba3ac3ee19def9399`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:04.490510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:04.575927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 918/1806] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:04.580989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:04.602792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.649220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adbf91-b905-475e-93e6-8d65abc9666c service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:04.654375 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:04.655869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:04.655869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:04.656096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:04.656778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:04.658725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:04.667901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.750962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 889/1807] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:04 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:04.755481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:04.767540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7275ad-5cbf-4b43-9002-04156aec9455 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:04.832341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:04.832965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:04.833249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:04.833611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:04.834253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:04.836195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:04.856124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.933681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 919/1808] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:04 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:04.938576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:04.949121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f04d6-44ee-4845-9f6a-f52776fc68d0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:04.950625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:04.954166 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:04.954980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:04.955728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:04.956202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:04.957145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:04.958855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:04.970174 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 890/1809] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:04.974508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:04.985052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a03e0-649f-48ea-94d2-db55ed19bb41 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:04.989746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:04.990389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:04.990668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:04.990942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] PATH_INFO: `/v3/projects/bb0b101bf1ed4383aebc14f00a100d2a/users/0cb9cb49beb94abda73060bc744eee8a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:05.005671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0b101bf1ed4383aebc14f00a100d2a, user_id=0cb9cb49beb94abda73060bc744eee8a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:05.008311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:05.107146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 920/1810] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:04 2022] PUT /identity/v3/projects/bb0b101bf1ed4383aebc14f00a100d2a/users/0cb9cb49beb94abda73060bc744eee8a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:05.111029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:05.120931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8dd8-002d-4785-b7e8-07e6b1b131cd admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:05.177539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:05.178420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:05.178700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:05.178973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:05.179615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:05.181315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:05.191626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 891/1811] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:05.195764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:05.208072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc70e7-322e-4ba5-b6d4-fd13c973da4b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:05.213130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:05.213860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:05.214151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:05.214424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] PATH_INFO: `/v3/projects/bb0b101bf1ed4383aebc14f00a100d2a/users/0cb9cb49beb94abda73060bc744eee8a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:05.216368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb0b101bf1ed4383aebc14f00a100d2a, user_id=0cb9cb49beb94abda73060bc744eee8a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:05.219922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:05.230343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 921/1812] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:05 2022] PUT /identity/v3/projects/bb0b101bf1ed4383aebc14f00a100d2a/users/0cb9cb49beb94abda73060bc744eee8a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:05.238678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:05.282667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:05.610632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:05.780106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:05.862904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:05.865008 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:05.930021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28941f-c7ab-430e-b26c-e05d7e1f7faf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:05.989936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d689f5a-82a2-4dbb-adf6-012851b4b662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:05.990587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d689f5a-82a2-4dbb-adf6-012851b4b662 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:05.990857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d689f5a-82a2-4dbb-adf6-012851b4b662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:05.991129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d689f5a-82a2-4dbb-adf6-012851b4b662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.063101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d689f5a-82a2-4dbb-adf6-012851b4b662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:06.064608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d689f5a-82a2-4dbb-adf6-012851b4b662 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:06.077762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 892/1813] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:06.121252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:06.123259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.209558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75127fa-8048-4f12-af28-2f35318a819c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:06.214254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:06.214887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:06.215164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:06.215442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] PATH_INFO: `/v3/users/f592adc30a7746bd8e7524b33eeb9936` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.216633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f592adc30a7746bd8e7524b33eeb9936)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:06.219077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:06.372603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f592adc30a7746bd8e7524b33eeb9936'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:06.381191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f592adc30a7746bd8e7524b33eeb9936'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:06.398165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f592adc30a7746bd8e7524b33eeb9936'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:06.399047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f592adc30a7746bd8e7524b33eeb9936'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:06.467026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-32e09d4f-939f-4efa-9999-23f0810c1fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f592adc30a7746bd8e7524b33eeb9936'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:06.477772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 922/1814] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:06 2022] DELETE /identity/v3/users/f592adc30a7746bd8e7524b33eeb9936 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:06.481832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:06.482070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:06.482347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870272-dd8d-463e-ac24-5028c08d1a5b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:06.482528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.482875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870272-dd8d-463e-ac24-5028c08d1a5b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:06.483817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870272-dd8d-463e-ac24-5028c08d1a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.498221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:06.512241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:06.513482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.543277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cb870272-dd8d-463e-ac24-5028c08d1a5b None None] MFA Rules not processed for user `0cb9cb49beb94abda73060bc744eee8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:06.544764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb870272-dd8d-463e-ac24-5028c08d1a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.545064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:06.603898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 893/1815] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:06.621085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:06.622542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.644151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 923/1816] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:06.645969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:06.646340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:06.646619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.672446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] MFA Rules not processed for user `73ae4a16f6004c1ba3ac3ee19def9399`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:06.672446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.701657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0e76d-e816-4f6e-831f-58e268c446a2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:06.706362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:06.706971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:06.707251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:06.707523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.718697 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:06.720369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:06.730555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 894/1817] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:09:06.739774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 924/1818] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:09:06.745194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:06.746586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.824264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b634-16fc-4c75-b2c2-fec9f8d60628 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:06.830854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:06.831466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:06.831747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:06.832023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:06.833801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:06.845203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:06.848280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:06.855722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 925/1819] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:07.171197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:07.173184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:07.203677 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d131cc-77b2-450a-b504-e5d57644318f service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:07.209530 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:07.210229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:07.210512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:07.210785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] PATH_INFO: `/v3/projects/473180f95cdd4a30aa7444a7d6b1bbc3` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:07.211892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] RBAC: Authorizing `identity:delete_project(project_id=473180f95cdd4a30aa7444a7d6b1bbc3)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:07.213832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:07.318732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473180f95cdd4a30aa7444a7d6b1bbc3', 'request_id': 'req-cc63a317-bc12-49e2-a908-9c176470931a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:07.324719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473180f95cdd4a30aa7444a7d6b1bbc3', 'request_id': 'req-cc63a317-bc12-49e2-a908-9c176470931a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:07.338850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473180f95cdd4a30aa7444a7d6b1bbc3', 'request_id': 'req-cc63a317-bc12-49e2-a908-9c176470931a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:07.356431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:07.470477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] The token cache is being invalidate because project 473180f95cdd4a30aa7444a7d6b1bbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:07.470940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:07.471455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:07.473099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 895/1820] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:07 2022] DELETE /identity/v3/projects/473180f95cdd4a30aa7444a7d6b1bbc3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:07.711669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:07.713147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:07.785388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50c089-8189-4f80-be19-ef707ee40059 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:07.840961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:07.841768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:07.842804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:07.843515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:07.845440 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:07.867802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:07.915555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:07.917076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396d865-48c6-4c7a-bb1c-fb1b722c1e98 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:07.930244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 926/1821] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:08.341028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:08.553540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:09.110666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:09.163082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:09.387134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:09.482210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:10.004002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:10.524269 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:10.836753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:11.118205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:11.569596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:11.912982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:12.655289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:12.769629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:12.771183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:12.784070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:12.838778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63a317-bc12-49e2-a908-9c176470931a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:12.844161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:12.844827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:12.845108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:12.845511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] PATH_INFO: `/v3/users/7067e540ef484399bd21169fade3a098` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:12.847958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7067e540ef484399bd21169fade3a098)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:12.849939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:13.091970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7067e540ef484399bd21169fade3a098'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:13.102232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7067e540ef484399bd21169fade3a098'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:13.103013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7067e540ef484399bd21169fade3a098'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:13.186390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7067e540ef484399bd21169fade3a098'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:13.202744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7067e540ef484399bd21169fade3a098'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:13.210119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 896/1822] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:12 2022] DELETE /identity/v3/users/7067e540ef484399bd21169fade3a098 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:13.214733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:13.219057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:13.219057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:13.235133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:13.236427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:13.303382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 927/1823] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:09:13.314140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:13.315603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:13.325401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:13.378095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0859521-b290-4dd6-85de-0267450ffdec admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:13.378719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:13.381726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:13.382336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:13.382618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:13.382890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:13.392206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:13.393740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:13.403716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 897/1824] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:09:13.552314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:13.581365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:13.610914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:13.768940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:13.957492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:13.959049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:13.985947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af8f1a-d0b6-4331-b508-c3045e825036 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:13.991169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:13.991987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:13.992275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:13.992621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] PATH_INFO: `/v3/projects/edb6b87dc2ec47678d7fb4659b07621b` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:13.993763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb6b87dc2ec47678d7fb4659b07621b)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:13.995724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:14.054874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:14.115408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb6b87dc2ec47678d7fb4659b07621b', 'request_id': 'req-a20436a2-79a1-47af-9814-2627f93170b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.122104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb6b87dc2ec47678d7fb4659b07621b', 'request_id': 'req-a20436a2-79a1-47af-9814-2627f93170b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.201117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb6b87dc2ec47678d7fb4659b07621b', 'request_id': 'req-a20436a2-79a1-47af-9814-2627f93170b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.212995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] The token cache is being invalidate because project edb6b87dc2ec47678d7fb4659b07621b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:14.213279 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.213915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.215396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 928/1825] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:13 2022] DELETE /identity/v3/projects/edb6b87dc2ec47678d7fb4659b07621b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:14.220033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:14.229734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca617240-cea3-434e-8888-4645628d96ec service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:14.229889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:14.260598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:14.288803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:14.289870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:14.290155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:14.293004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] PATH_INFO: `/v3/users/bc9bf4f512ca47bab7a534b8e89e9cfd` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:14.293004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9bf4f512ca47bab7a534b8e89e9cfd)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:14.293728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:14.298800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:14.478393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9bf4f512ca47bab7a534b8e89e9cfd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.485275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9bf4f512ca47bab7a534b8e89e9cfd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.485929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9bf4f512ca47bab7a534b8e89e9cfd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.492895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:14.550206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9bf4f512ca47bab7a534b8e89e9cfd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.564048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9bf4f512ca47bab7a534b8e89e9cfd'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:14.569853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 898/1826] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:14 2022] DELETE /identity/v3/users/bc9bf4f512ca47bab7a534b8e89e9cfd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:14.607967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:15.077421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:15.078990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:15.092636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20436a2-79a1-47af-9814-2627f93170b9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:15.152305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:15.152975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:15.153258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:15.153538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] PATH_INFO: `/v3/projects/5aca67ab0a154725a23f9f677df912fc` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:15.154673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aca67ab0a154725a23f9f677df912fc)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:15.157166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:15.264179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aca67ab0a154725a23f9f677df912fc', 'request_id': 'req-dcbec14f-760d-4b72-8aaf-030ea30e1e27'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.270353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aca67ab0a154725a23f9f677df912fc', 'request_id': 'req-dcbec14f-760d-4b72-8aaf-030ea30e1e27'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.338165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aca67ab0a154725a23f9f677df912fc', 'request_id': 'req-dcbec14f-760d-4b72-8aaf-030ea30e1e27'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.350669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] The token cache is being invalidate because project 5aca67ab0a154725a23f9f677df912fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:15.350988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.351631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.353627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 929/1827] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:15 2022] DELETE /identity/v3/projects/5aca67ab0a154725a23f9f677df912fc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:15.357541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:15.359822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:15.372667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a72d-567f-41a5-bcf1-abd0f9141905 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:15.430172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:15.430813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:15.431097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:15.431372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] PATH_INFO: `/v3/users/7f6f1cbc4a84461b9dda14c6983f725b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:15.432639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6f1cbc4a84461b9dda14c6983f725b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:15.434578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:15.666340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6f1cbc4a84461b9dda14c6983f725b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.673762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6f1cbc4a84461b9dda14c6983f725b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.674463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6f1cbc4a84461b9dda14c6983f725b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.746106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6f1cbc4a84461b9dda14c6983f725b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.758961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2adc6971-30f7-43b6-8259-8946de4d3b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6f1cbc4a84461b9dda14c6983f725b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:15.764909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 899/1828] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:15 2022] DELETE /identity/v3/users/7f6f1cbc4a84461b9dda14c6983f725b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:16.252977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:16.252977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:16.268675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbec14f-760d-4b72-8aaf-030ea30e1e27 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:16.316979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:16.331396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:16.332032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:16.332310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:16.332621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] PATH_INFO: `/v3/projects/f414b9c276a9408a85c0424299b881b4` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:16.333883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f414b9c276a9408a85c0424299b881b4)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:16.335839 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:16.437879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f414b9c276a9408a85c0424299b881b4', 'request_id': 'req-482bc921-5095-4a81-91cd-d1bb36d7a59d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:16.445613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f414b9c276a9408a85c0424299b881b4', 'request_id': 'req-482bc921-5095-4a81-91cd-d1bb36d7a59d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:16.498250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f414b9c276a9408a85c0424299b881b4', 'request_id': 'req-482bc921-5095-4a81-91cd-d1bb36d7a59d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:16.510849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] The token cache is being invalidate because project f414b9c276a9408a85c0424299b881b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:16.511134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:16.511780 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-482bc921-5095-4a81-91cd-d1bb36d7a59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:16.513290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 930/1829] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:16 2022] DELETE /identity/v3/projects/f414b9c276a9408a85c0424299b881b4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:16.518209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:16.518671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:16.518761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:16.526454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:16.539117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:16.540326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:16.599868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 900/1830] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:16.608405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:16.608701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:16.608985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:16.629658 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:16.631109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:16.639529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 931/1831] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:16.643825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:16.653529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f23d51-4216-45c1-b0c5-f9785406ad85 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:16.658208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:16.658849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:16.659135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:16.660056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:16.661043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:09:16.661442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:16.664452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:16.677422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 901/1832] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:09:16.681943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:16.691158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093374c3-67af-4315-9db4-c08c5fade19b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:16.695853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:16.696486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:16.696769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:16.697044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:16.697681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:16.699582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:16.804108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 932/1833] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:16 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:16.807394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:16.817469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ff62c-f21a-4f62-be69-e0b7071164ba admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:16.876118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:16.876775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:16.877061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:16.877335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:16.878039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:16.880047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:16.983765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 902/1834] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:16 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:16.987903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:16.998503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73874463-149d-4a28-a550-90883bbfb327 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.003477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.004169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.004611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.004972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.005707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.007385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.017115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 933/1835] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:17.023768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.033749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8c563-5202-4dc9-b066-55f5de59b599 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.039039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a748de-e083-4d87-b317-5bd8d35bc5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.039757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a748de-e083-4d87-b317-5bd8d35bc5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.040040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a748de-e083-4d87-b317-5bd8d35bc5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.040319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a748de-e083-4d87-b317-5bd8d35bc5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.041014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a748de-e083-4d87-b317-5bd8d35bc5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.045683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a748de-e083-4d87-b317-5bd8d35bc5a0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.056107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 903/1836] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:17.057429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.068268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4668056-5183-44e3-ac3f-d4e979418804 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.073067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.073834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.074064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.074463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] PATH_INFO: `/v3/projects/7843bda142134d1d8dd59d96f92af23c/users/55ed9b31e7224b9fb0750867221d8e4d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.090027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7843bda142134d1d8dd59d96f92af23c, user_id=55ed9b31e7224b9fb0750867221d8e4d, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.092761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.179891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 934/1837] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:17 2022] PUT /identity/v3/projects/7843bda142134d1d8dd59d96f92af23c/users/55ed9b31e7224b9fb0750867221d8e4d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:17.192270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.192598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.192871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.220176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] MFA Rules not processed for user `55ed9b31e7224b9fb0750867221d8e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:17.221398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:17.286303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:17.292112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 904/1838] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:17.300819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.369943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49223309-0c39-457e-bb1d-53a2a0f0fb86 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.375448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.376214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.376527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.376806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.377456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.379958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.396740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:17.491031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 935/1839] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:17 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:17.492507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.503751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6dc8c-ca92-4061-9212-5384314bef6f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.558289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.558903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.559161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.559453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.560087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.562059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.669634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 905/1840] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:17 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:17.670803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.682129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c542ab9-5855-4b65-9016-cedc52c18d3d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.686965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.687572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.687873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.688124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.688796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.690384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.704542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 936/1841] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:17.705973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.716107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221b992-531e-4775-951e-a6384e935fab admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.720990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715d41f-851c-4bef-9577-94ce29638fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.721602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d41f-851c-4bef-9577-94ce29638fea admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.721887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d41f-851c-4bef-9577-94ce29638fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.722161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715d41f-851c-4bef-9577-94ce29638fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.722815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715d41f-851c-4bef-9577-94ce29638fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.724472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715d41f-851c-4bef-9577-94ce29638fea admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.734448 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 906/1842] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:17.739060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:17.749682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb3ae-947e-4dc7-a027-fd18a9f55fcd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:17.754867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:17.755515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.755799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.756074 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] PATH_INFO: `/v3/projects/9df6ef1fe8cf49d18134f16b0219443c/users/f71fec4f0b93424597b917a4cd6cbc8d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.770759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df6ef1fe8cf49d18134f16b0219443c, user_id=f71fec4f0b93424597b917a4cd6cbc8d, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:17.773502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:17.866453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 937/1843] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:17 2022] PUT /identity/v3/projects/9df6ef1fe8cf49d18134f16b0219443c/users/f71fec4f0b93424597b917a4cd6cbc8d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:17.933315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:17.933516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:17.933785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:17.961559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] MFA Rules not processed for user `f71fec4f0b93424597b917a4cd6cbc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:17.964215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:18.024968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 907/1844] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:18.029394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.093377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08d26f-bd35-4703-9759-7c267357c443 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.098579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.099186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.099471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.099747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.100430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.102349 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.191366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 938/1845] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:18 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:18.191655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.198106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f7a4f-5782-4b17-8bd0-0e2b61a777ed None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.257060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.257678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.257967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.258245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.258878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.260868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.271712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:18.345895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 908/1846] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:18 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:18.350322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.361016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c109cd-4326-4c2f-864f-69eedd972c52 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.366962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.367672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.367835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.368106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.368789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.370376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.382333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 939/1847] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:18.386390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.396758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1d85a-e603-47cd-b590-459c34da0a11 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.401586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.409262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.409262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.409262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] PATH_INFO: `/v3/projects/2ea2f2cd1ec6461cb22713238774b14f/users/80ed73e1dffc4a6c9c51a251f119cf4c/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.418485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea2f2cd1ec6461cb22713238774b14f, user_id=80ed73e1dffc4a6c9c51a251f119cf4c, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.421170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.521582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 909/1848] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:18 2022] PUT /identity/v3/projects/2ea2f2cd1ec6461cb22713238774b14f/users/80ed73e1dffc4a6c9c51a251f119cf4c/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:18.526186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.539381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89974128-b091-466a-8604-f8594369bde6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.604107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3bb4-4be1-4c5b-a12a-c41d4dfb7bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.604756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3bb4-4be1-4c5b-a12a-c41d4dfb7bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.605042 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3bb4-4be1-4c5b-a12a-c41d4dfb7bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.605320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3bb4-4be1-4c5b-a12a-c41d4dfb7bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.605968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3bb4-4be1-4c5b-a12a-c41d4dfb7bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.607572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3bb4-4be1-4c5b-a12a-c41d4dfb7bfa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.618355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 940/1849] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:18.621969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.633664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2aeb6f-6539-4540-8ac3-7d977e34312a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.638533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.639208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.639469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.639745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] PATH_INFO: `/v3/projects/2ea2f2cd1ec6461cb22713238774b14f/users/80ed73e1dffc4a6c9c51a251f119cf4c/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.641700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea2f2cd1ec6461cb22713238774b14f, user_id=80ed73e1dffc4a6c9c51a251f119cf4c, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.645057 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.656978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 910/1850] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:18 2022] PUT /identity/v3/projects/2ea2f2cd1ec6461cb22713238774b14f/users/80ed73e1dffc4a6c9c51a251f119cf4c/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:18.675866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.676380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.678324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.707861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] MFA Rules not processed for user `80ed73e1dffc4a6c9c51a251f119cf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:18.709241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:18.731226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:18.782096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 941/1851] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:18.793455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:18.795363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:18.853382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d951-0d93-46d9-a6a7-6ab12f1e51ea admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:18.856996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:18.857595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:18.857876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:18.858287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:18.914229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:18.915747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:18.924575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 911/1852] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:09:21.136865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:21.147814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f79e-c09b-4fdc-88e8-a237f19f4f4f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:21.152001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:21.152639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:21.152921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:21.153195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:21.215969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:21.217469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:21.226876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 942/1853] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:22.635237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:22.643672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c55ebc-872c-41a6-94bf-0e66dec20820 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:22.647886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:22.648544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:22.648823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:22.652334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:22.658192 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:22.659611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:22.669098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 912/1854] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:27.503534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:27.505090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:27.517988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e082907-db91-42b8-a9c8-e6f3b288f3ad service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:27.522271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:27.523005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:27.523281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:27.523550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:27.525419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:27.600620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:27.603238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db10213-a1bf-4675-bc88-9862a3c2afa5 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:27.616841 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 943/1855] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:27.621565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:27.725453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddccca-52b9-4d4c-a974-d55c59e0e82f service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:27.730099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:27.730736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:27.731020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:27.731296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] PATH_INFO: `/v3/users/55ed9b31e7224b9fb0750867221d8e4d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:27.732557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ed9b31e7224b9fb0750867221d8e4d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:27.734501 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:27.736165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:27.953762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ed9b31e7224b9fb0750867221d8e4d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:27.967069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ed9b31e7224b9fb0750867221d8e4d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:27.967991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ed9b31e7224b9fb0750867221d8e4d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:28.030654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ed9b31e7224b9fb0750867221d8e4d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:28.046159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ed9b31e7224b9fb0750867221d8e4d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:28.053044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 913/1856] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:27 2022] DELETE /identity/v3/users/55ed9b31e7224b9fb0750867221d8e4d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:28.057506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:28.057824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:28.058104 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:28.078743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:28.080220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:28.133255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:28.150893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 944/1857] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:28.161026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:28.162465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:28.222254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5437-9598-4096-9a9f-ad52ddb46d79 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:28.226149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:28.226755 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:28.227036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:28.227309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:28.237468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:28.238910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:28.249398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 914/1858] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:28.740877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:28.742386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:28.757489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05116630-3a56-4d2f-b4ea-ccca43c4d477 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:28.763185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:28.764164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:28.764473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:28.764857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] PATH_INFO: `/v3/projects/7843bda142134d1d8dd59d96f92af23c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:28.766578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7843bda142134d1d8dd59d96f92af23c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:28.768532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:28.917489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7843bda142134d1d8dd59d96f92af23c', 'request_id': 'req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:28.923727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7843bda142134d1d8dd59d96f92af23c', 'request_id': 'req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.070486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7843bda142134d1d8dd59d96f92af23c', 'request_id': 'req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.082132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] The token cache is being invalidate because project 7843bda142134d1d8dd59d96f92af23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:29.082419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.083054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.084576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 945/1859] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:28 2022] DELETE /identity/v3/projects/7843bda142134d1d8dd59d96f92af23c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:29.088497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:29.098437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb254b-b18e-4630-a879-f147a8b0c7a9 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:29.161477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:29.162806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:29.163272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:29.163550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] PATH_INFO: `/v3/users/f71fec4f0b93424597b917a4cd6cbc8d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:29.164741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71fec4f0b93424597b917a4cd6cbc8d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:29.166838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:29.192651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:29.370260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71fec4f0b93424597b917a4cd6cbc8d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.377209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71fec4f0b93424597b917a4cd6cbc8d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.378073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71fec4f0b93424597b917a4cd6cbc8d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.451827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71fec4f0b93424597b917a4cd6cbc8d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.466214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71fec4f0b93424597b917a4cd6cbc8d'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:29.472433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 915/1860] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:29 2022] DELETE /identity/v3/users/f71fec4f0b93424597b917a4cd6cbc8d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:29.947234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:29.948906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:29.963460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86432d-6b01-49f5-a37c-f2b5fdaaba4a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:30.023488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:30.024130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:30.024446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:30.024731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] PATH_INFO: `/v3/projects/9df6ef1fe8cf49d18134f16b0219443c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:30.025893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df6ef1fe8cf49d18134f16b0219443c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:30.027845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:30.184283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df6ef1fe8cf49d18134f16b0219443c', 'request_id': 'req-e1d385ff-61ea-4c88-97af-cf6515145e9b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.190496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df6ef1fe8cf49d18134f16b0219443c', 'request_id': 'req-e1d385ff-61ea-4c88-97af-cf6515145e9b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.235597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df6ef1fe8cf49d18134f16b0219443c', 'request_id': 'req-e1d385ff-61ea-4c88-97af-cf6515145e9b'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.246345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] The token cache is being invalidate because project 9df6ef1fe8cf49d18134f16b0219443c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:30.246637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.247292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.248817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 946/1861] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:29 2022] DELETE /identity/v3/projects/9df6ef1fe8cf49d18134f16b0219443c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:30.253222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:30.254434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:30.271459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec07b35-057d-4c39-bed0-a4430494c8fc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:30.340503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:30.341133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:30.341413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:30.341685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] PATH_INFO: `/v3/users/80ed73e1dffc4a6c9c51a251f119cf4c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:30.342880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ed73e1dffc4a6c9c51a251f119cf4c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:30.344840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:30.553069 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ed73e1dffc4a6c9c51a251f119cf4c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.560983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ed73e1dffc4a6c9c51a251f119cf4c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.561675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ed73e1dffc4a6c9c51a251f119cf4c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.624795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ed73e1dffc4a6c9c51a251f119cf4c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.639288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-608b96f0-94ac-455b-897d-744bbaaa736d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ed73e1dffc4a6c9c51a251f119cf4c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:30.645632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 916/1862] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:30 2022] DELETE /identity/v3/users/80ed73e1dffc4a6c9c51a251f119cf4c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:31.253006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:31.254488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:31.262235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:31.267619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d385ff-61ea-4c88-97af-cf6515145e9b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:31.374172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:31.374829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:31.375114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:31.375397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] PATH_INFO: `/v3/projects/2ea2f2cd1ec6461cb22713238774b14f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:31.377058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea2f2cd1ec6461cb22713238774b14f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:31.378986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:31.495550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea2f2cd1ec6461cb22713238774b14f', 'request_id': 'req-7f90ceb9-971c-471f-b2b6-8fee70527765'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:31.501908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea2f2cd1ec6461cb22713238774b14f', 'request_id': 'req-7f90ceb9-971c-471f-b2b6-8fee70527765'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:31.607855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea2f2cd1ec6461cb22713238774b14f', 'request_id': 'req-7f90ceb9-971c-471f-b2b6-8fee70527765'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:31.618930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] The token cache is being invalidate because project 2ea2f2cd1ec6461cb22713238774b14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:31.619208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:31.619911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7f90ceb9-971c-471f-b2b6-8fee70527765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:31.621423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 947/1863] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:31 2022] DELETE /identity/v3/projects/2ea2f2cd1ec6461cb22713238774b14f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:31.626679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:31.627127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:31.627215 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:31.647219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:31.649042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:31.661815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:31.708328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 917/1864] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:31.716763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:31.717056 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:31.717333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:31.736723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:31.737932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:31.746124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 948/1865] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:31.750005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:31.760408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da654e23-fa15-41e3-903e-200b13aa587d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:31.765041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:31.765633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:31.765922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:31.766190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:31.766827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:09:31.767129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:31.768754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:31.784750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 918/1866] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:09:31.785760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:31.796054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e68d0-0e19-4cf5-8569-fbf4999dbef9 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:31.801269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:31.810829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:31.811117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:31.811393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:31.812062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:31.814377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:31.933143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 949/1867] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:31 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:31.938730 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:31.949300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4383a4-692f-46ec-b8b1-b8b0caf9aaa1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:32.007767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:32.008383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:32.008695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:32.008966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:32.009602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:32.011640 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:32.179686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 919/1868] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:31 2022] POST /identity/v3/users => generated 296 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:32.181018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:32.194678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713cd8b-006d-42bc-86f3-cccccb388b0c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:32.199829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:32.200509 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:32.200790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:32.201062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:32.201701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:32.203333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:32.217072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 950/1869] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:32.218914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:32.230317 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fb902-038e-442e-b64f-57a59b0126fb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:32.249015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a2c5e-8fea-4a0e-8997-6436bf9a3949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:32.249015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2c5e-8fea-4a0e-8997-6436bf9a3949 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:32.249015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2c5e-8fea-4a0e-8997-6436bf9a3949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:32.249015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a2c5e-8fea-4a0e-8997-6436bf9a3949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:32.249426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a2c5e-8fea-4a0e-8997-6436bf9a3949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:32.249426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a2c5e-8fea-4a0e-8997-6436bf9a3949 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:32.261997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 920/1870] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:32.270057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:32.284108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70f46f-a976-4c9a-9e5b-3b2ea2064af0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:32.304702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:32.307818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:32.308296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:32.308859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] PATH_INFO: `/v3/projects/6744531f5af34f21b05eba37fa8095ad/users/2062bbcd55554ab5a41ba1e1f49d10c7/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:32.339207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6744531f5af34f21b05eba37fa8095ad, user_id=2062bbcd55554ab5a41ba1e1f49d10c7, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:32.341918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:32.417075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 951/1871] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:32 2022] PUT /identity/v3/projects/6744531f5af34f21b05eba37fa8095ad/users/2062bbcd55554ab5a41ba1e1f49d10c7/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:32.427176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:32.427475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:32.427757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:32.461359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] MFA Rules not processed for user `2062bbcd55554ab5a41ba1e1f49d10c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:32.462695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:32.577091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 921/1872] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:32.589508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:32.591863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:32.626018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:32.657290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e03cd-1db1-4425-8861-cb697e31038d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:32.661249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48097371-1e82-4856-b0ad-1b5002fa1437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:32.661925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48097371-1e82-4856-b0ad-1b5002fa1437 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:32.662208 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48097371-1e82-4856-b0ad-1b5002fa1437 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:32.662487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48097371-1e82-4856-b0ad-1b5002fa1437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:32.673538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48097371-1e82-4856-b0ad-1b5002fa1437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:32.675357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48097371-1e82-4856-b0ad-1b5002fa1437 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:32.685214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 952/1873] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:09:33.182749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:33.184183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:33.213107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:33.262793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6d0dc-61fc-4d6c-89fe-12a14dcb39b5 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:33.267604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:33.268246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:33.268665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:33.268868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] PATH_INFO: `/v3/users/59251eeac2754429961e3720bf0c4ba9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:33.269974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59251eeac2754429961e3720bf0c4ba9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:33.272732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:33.534836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59251eeac2754429961e3720bf0c4ba9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:33.542394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59251eeac2754429961e3720bf0c4ba9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:33.543339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59251eeac2754429961e3720bf0c4ba9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:33.629928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59251eeac2754429961e3720bf0c4ba9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:33.643656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59251eeac2754429961e3720bf0c4ba9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:33.649689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 922/1874] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:33 2022] DELETE /identity/v3/users/59251eeac2754429961e3720bf0c4ba9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:33.654362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:33.654903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:33.658966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:33.674523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:33.675962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:33.735005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 953/1875] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:33.745426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:33.747012 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:33.812203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9991-eeae-4c3f-aa2a-8f7f168ea120 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:33.815834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a92b4-3b8f-4866-b8b8-12fc61bbe6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:33.816484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a92b4-3b8f-4866-b8b8-12fc61bbe6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:33.816769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a92b4-3b8f-4866-b8b8-12fc61bbe6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:33.817045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a92b4-3b8f-4866-b8b8-12fc61bbe6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:33.827035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a92b4-3b8f-4866-b8b8-12fc61bbe6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:33.828551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a92b4-3b8f-4866-b8b8-12fc61bbe6f2 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:33.839962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 923/1876] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:34.436787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:34.438608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:34.469920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18134c04-dddd-441a-bc81-05f7c448d77b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:34.479005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:34.479827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:34.480259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:34.480566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] PATH_INFO: `/v3/projects/39e84d2bb3924dd6a26bddf1349debe3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:34.481757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e84d2bb3924dd6a26bddf1349debe3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:34.483947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:34.677947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e84d2bb3924dd6a26bddf1349debe3', 'request_id': 'req-d0ff1152-768b-45e0-a550-bc4648711b66'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:34.684881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e84d2bb3924dd6a26bddf1349debe3', 'request_id': 'req-d0ff1152-768b-45e0-a550-bc4648711b66'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:34.777333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e84d2bb3924dd6a26bddf1349debe3', 'request_id': 'req-d0ff1152-768b-45e0-a550-bc4648711b66'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:34.806943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] The token cache is being invalidate because project 39e84d2bb3924dd6a26bddf1349debe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:34.807431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:34.810037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d0ff1152-768b-45e0-a550-bc4648711b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:34.810037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 954/1877] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:34 2022] DELETE /identity/v3/projects/39e84d2bb3924dd6a26bddf1349debe3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:34.817749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:34.818226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:34.818316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:34.839081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:34.840327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:34.872637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:34.899514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 924/1878] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:34.908868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:34.913551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:34.913551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:34.930282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:34.931526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:34.939461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 955/1879] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:34.943661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:34.953657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c21bbc-bd31-4983-bcb8-38d6ce790759 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:34.958612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:34.959206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:34.965051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:34.965051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:34.965051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:09:34.965051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:34.965051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:34.973854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 925/1880] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:09:34.978381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:34.988372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff92b2-1ac9-495c-ae03-a6a1be6fcf2f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:34.993685 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:34.994400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:34.994681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:34.994954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:34.995585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:34.997502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:35.141715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 956/1881] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:34 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:35.145835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:35.161580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285548f5-4868-45bc-9fae-6e194013e7cd admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:35.219884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:35.220781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:35.221073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:35.221351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:35.222133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:35.224066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:35.316052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 926/1882] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:35 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:35.320127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:35.330573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceae6b-6ce9-43a1-8d58-b475c3fb6253 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:35.335170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:35.335760 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:35.336038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:35.336308 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:35.337008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:35.338635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:35.348609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 957/1883] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:35.353106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:35.363074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb84cf9-3ea2-4a43-8e8f-7d5573db680a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:35.368454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf06445-1176-4194-87a4-af47f3f352e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:35.369056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06445-1176-4194-87a4-af47f3f352e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:35.369333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06445-1176-4194-87a4-af47f3f352e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:35.369606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06445-1176-4194-87a4-af47f3f352e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:35.370246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf06445-1176-4194-87a4-af47f3f352e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:35.371877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf06445-1176-4194-87a4-af47f3f352e8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:35.382470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 927/1884] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:35.386516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:35.396245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753c2b-a6e4-426c-9b18-97b064c592e7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:35.400791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:35.411221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:35.411221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:35.411221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] PATH_INFO: `/v3/projects/709ccf636093493093e88488ce49484f/users/c79116777e354734b73a0b334fd013c9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:35.414294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:35.417275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ccf636093493093e88488ce49484f, user_id=c79116777e354734b73a0b334fd013c9, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:35.419912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:35.504683 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 958/1885] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:35 2022] PUT /identity/v3/projects/709ccf636093493093e88488ce49484f/users/c79116777e354734b73a0b334fd013c9/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:35.509994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d8f7a-f25d-465d-a235-6ebce5ed29ca None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:35.511263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d8f7a-f25d-465d-a235-6ebce5ed29ca None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:35.511263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d8f7a-f25d-465d-a235-6ebce5ed29ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:35.531102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a85d8f7a-f25d-465d-a235-6ebce5ed29ca None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:35.531936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a85d8f7a-f25d-465d-a235-6ebce5ed29ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:35.595005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 928/1886] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:35.605312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:35.607115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:35.677618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524761-295a-4e3b-a028-725231f3f441 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:35.681670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac9f4-322f-43c3-adac-efdc05612d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:35.682320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac9f4-322f-43c3-adac-efdc05612d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:35.682608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac9f4-322f-43c3-adac-efdc05612d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:35.682885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac9f4-322f-43c3-adac-efdc05612d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:35.694963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac9f4-322f-43c3-adac-efdc05612d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:35.696704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac9f4-322f-43c3-adac-efdc05612d06 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:35.708144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 959/1887] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:41.477851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:41.478982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:41.479259 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:41.507128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] MFA Rules not processed for user `4553b7573ca34af6a9fdb94f80717f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:41.507353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:41.559087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:41.577935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 929/1888] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:43.937024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:43.937540 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:43.940751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.027276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] MFA Rules not processed for user `c79116777e354734b73a0b334fd013c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:44.029045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:44.125126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 960/1889] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:44.129817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:44.147529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b6a91-1363-43a8-b791-e8142d2eadc7 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:44.157753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:44.158686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:44.159025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:44.159763 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.160599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:44.163250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:44.278630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 930/1890] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:09:44 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:09:44.292618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:44.295451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd2f25-773f-4812-9540-f0c8525875bd None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:44.418689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:44.419452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:44.419850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:44.420424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.421609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:44.423739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:44.563442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 961/1891] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:09:44 2022] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:09:44.571180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:44.581465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856054-d13f-4ff4-94b7-e0afb7e600d4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:44.590187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:44.590187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:44.590187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:44.590187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.590598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:44.591921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:44.605343 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 931/1892] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:09:44.608872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:44.619928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b17be-f6c7-4dc4-afe2-b01279b20cf0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:44.625951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:44.626885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:44.627181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:44.627559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] PATH_INFO: `/v3/projects/498a5c4e87964f8d90611e29a052f911/users/140927ae18a748178917c597bceda7a3/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.640050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:44.644095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498a5c4e87964f8d90611e29a052f911, user_id=140927ae18a748178917c597bceda7a3, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:44.648123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:44.766473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 962/1893] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:44 2022] PUT /identity/v3/projects/498a5c4e87964f8d90611e29a052f911/users/140927ae18a748178917c597bceda7a3/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:44.770179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:44.782451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3f894-e963-4362-b9a1-496fb8de0d74 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:44.851875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:44.852969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:44.852969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:44.852969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.853634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:44.855258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:44.865989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 932/1894] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:09:44.870108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:44.881268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0ad0d-790c-4aa4-b1de-d61fb669c1f3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:44.887179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dd0e9-c90d-4204-99d3-75858736098e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:44.887825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dd0e9-c90d-4204-99d3-75858736098e admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:44.888103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dd0e9-c90d-4204-99d3-75858736098e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:44.888375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dd0e9-c90d-4204-99d3-75858736098e admin admin] PATH_INFO: `/v3/projects/498a5c4e87964f8d90611e29a052f911/users/140927ae18a748178917c597bceda7a3/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:44.890309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dd0e9-c90d-4204-99d3-75858736098e admin admin] RBAC: Authorizing `identity:create_grant(project_id=498a5c4e87964f8d90611e29a052f911, user_id=140927ae18a748178917c597bceda7a3, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:44.893012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dd0e9-c90d-4204-99d3-75858736098e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:44.904797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 963/1895] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:09:44 2022] PUT /identity/v3/projects/498a5c4e87964f8d90611e29a052f911/users/140927ae18a748178917c597bceda7a3/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:46.485455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:46.487312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:46.535979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a8045-752c-4405-be3c-5f7419b2cc59 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:46.644978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:46.649340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:46.649340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:46.649340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] PATH_INFO: `/v3/users/2062bbcd55554ab5a41ba1e1f49d10c7` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:46.649340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2062bbcd55554ab5a41ba1e1f49d10c7)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:46.651018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:46.906001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2062bbcd55554ab5a41ba1e1f49d10c7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:46.920868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:46.925153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2062bbcd55554ab5a41ba1e1f49d10c7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:46.930742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2062bbcd55554ab5a41ba1e1f49d10c7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:47.051994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2062bbcd55554ab5a41ba1e1f49d10c7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:47.072568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2062bbcd55554ab5a41ba1e1f49d10c7'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:47.085779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 933/1896] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:09:46 2022] DELETE /identity/v3/users/2062bbcd55554ab5a41ba1e1f49d10c7 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:09:47.090428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:47.090950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:47.090950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:47.136839 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:47.138100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:47.261893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 964/1897] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:47.329390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:47.330924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:47.432625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6833e-6d24-4e83-a082-930535b6b26d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:47.437364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed806ae-4c63-4f55-8e65-fde5aecc9505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:47.437628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed806ae-4c63-4f55-8e65-fde5aecc9505 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:47.437996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed806ae-4c63-4f55-8e65-fde5aecc9505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:47.438289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed806ae-4c63-4f55-8e65-fde5aecc9505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:47.450116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed806ae-4c63-4f55-8e65-fde5aecc9505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:47.451786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed806ae-4c63-4f55-8e65-fde5aecc9505 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:47.468633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 934/1898] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:48.336670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:48.341512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:48.373472 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e537d9-826b-4e80-a766-f40a150568b3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:48.407667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:48.408352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:48.408710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:48.408991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] PATH_INFO: `/v3/projects/6744531f5af34f21b05eba37fa8095ad` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:48.417908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6744531f5af34f21b05eba37fa8095ad)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:48.421616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:48.687280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6744531f5af34f21b05eba37fa8095ad', 'request_id': 'req-61f07f81-fd55-4011-98e2-e525da8763a0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:48.695521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6744531f5af34f21b05eba37fa8095ad', 'request_id': 'req-61f07f81-fd55-4011-98e2-e525da8763a0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:48.818233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6744531f5af34f21b05eba37fa8095ad', 'request_id': 'req-61f07f81-fd55-4011-98e2-e525da8763a0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:48.897398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] The token cache is being invalidate because project 6744531f5af34f21b05eba37fa8095ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:09:48.898101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:48.899809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-61f07f81-fd55-4011-98e2-e525da8763a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:09:48.917556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 965/1899] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:09:48 2022] DELETE /identity/v3/projects/6744531f5af34f21b05eba37fa8095ad => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:09:48.920840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:48.922250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:48.922743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:48.958835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] MFA Rules not processed for user `dbf0723a0f3942d2b9b2554320878016`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:48.961909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:49.165549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 935/1900] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:50.632719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cac7a-20dd-47c0-a45f-278d52effc39 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:50.632719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cac7a-20dd-47c0-a45f-278d52effc39 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:50.633383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cac7a-20dd-47c0-a45f-278d52effc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:50.696128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-927cac7a-20dd-47c0-a45f-278d52effc39 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:50.697386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-927cac7a-20dd-47c0-a45f-278d52effc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:50.809092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 966/1901] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:09:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:50.896568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:50.898721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:51.011635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962dee-1e5f-44f3-b6d2-b7c5a263bcd8 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:51.019122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:51.019892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:51.020414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:51.021537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:51.035256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:51.038156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:51.063786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 936/1902] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:09:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:09:55.477554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e3c7-1bc0-4fdf-a997-53a6771a5336 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:55.479272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e3c7-1bc0-4fdf-a997-53a6771a5336 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:55.479811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e3c7-1bc0-4fdf-a997-53a6771a5336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:55.510714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:55.560495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3ca4e3c7-1bc0-4fdf-a997-53a6771a5336 None None] MFA Rules not processed for user `140927ae18a748178917c597bceda7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:55.562881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3ca4e3c7-1bc0-4fdf-a997-53a6771a5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:55.714163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 967/1903] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:09:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:55.744686 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:55.746153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:55.760210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:09:55.819685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f81638-5fd3-4f72-888a-d0809bc8fad0 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:55.824186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:55.824859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:55.825203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:55.825525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:55.831000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:55.963836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:55.969006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:56.006476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 937/1904] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:09:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:09:56.565529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:56.566985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:56.567972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:56.613665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:09:56.618978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:09:56.636819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 968/1905] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:09:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:09:56.669307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:09:56.688974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548c10f-dbd3-40b3-8df1-429ccc6f1de3 service glance] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:09:56.714414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:09:56.716946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:09:56.717450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:09:56.718933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:09:56.747320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:09:56.748982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:09:56.778968 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 938/1906] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:09:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:03.184633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:03.186862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:03.348470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a192b8a-75d1-4e08-995f-65589434fe24 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:03.355275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:03.357424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:03.357424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:03.357424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] PATH_INFO: `/v3/users/73ae4a16f6004c1ba3ac3ee19def9399` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:03.358737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ae4a16f6004c1ba3ac3ee19def9399)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:03.361045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:03.668195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ae4a16f6004c1ba3ac3ee19def9399'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:03.674061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ae4a16f6004c1ba3ac3ee19def9399'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:03.701379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ae4a16f6004c1ba3ac3ee19def9399'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:03.702170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ae4a16f6004c1ba3ac3ee19def9399'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:03.798809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ae4a16f6004c1ba3ac3ee19def9399'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:03.810061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 969/1907] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:10:03 2022] DELETE /identity/v3/users/73ae4a16f6004c1ba3ac3ee19def9399 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:04.455694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:04.467706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38b3d-329b-48d4-bd73-40a4ce8a0ccc service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:04.633820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:04.634913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:04.636056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:04.636589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] PATH_INFO: `/v3/projects/2672469044ae418186a01036e653f609` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:04.638980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2672469044ae418186a01036e653f609)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:04.641236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:04.834960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2672469044ae418186a01036e653f609', 'request_id': 'req-9478b17e-cb4f-448d-9607-aae06525f432'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:04.840208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:04.855965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2672469044ae418186a01036e653f609', 'request_id': 'req-9478b17e-cb4f-448d-9607-aae06525f432'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:04.905113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2672469044ae418186a01036e653f609', 'request_id': 'req-9478b17e-cb4f-448d-9607-aae06525f432'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.040419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] The token cache is being invalidate because project 2672469044ae418186a01036e653f609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:10:05.040419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.040419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.040419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 939/1908] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:10:04 2022] DELETE /identity/v3/projects/2672469044ae418186a01036e653f609 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:05.047984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:05.047984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:05.065818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:05.087302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba53de3-a94f-45d7-94c2-e48731b65563 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:05.260520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:05.261002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:05.261286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:05.261570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] PATH_INFO: `/v3/users/0cb9cb49beb94abda73060bc744eee8a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:05.262787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb9cb49beb94abda73060bc744eee8a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:05.265093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:05.526374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb9cb49beb94abda73060bc744eee8a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.547862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb9cb49beb94abda73060bc744eee8a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.580656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb9cb49beb94abda73060bc744eee8a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.582000 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb9cb49beb94abda73060bc744eee8a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.742043 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd70b753-e22f-4c14-a07f-9b3f164f5aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb9cb49beb94abda73060bc744eee8a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:05.751568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 970/1909] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:10:05 2022] DELETE /identity/v3/users/0cb9cb49beb94abda73060bc744eee8a => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:06.230438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:06.232142 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:06.255253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b17e-cb4f-448d-9607-aae06525f432 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:06.460298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:06.461150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:06.461569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:06.462180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] PATH_INFO: `/v3/projects/bb0b101bf1ed4383aebc14f00a100d2a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:06.467505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb0b101bf1ed4383aebc14f00a100d2a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:06.469689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:06.695194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb0b101bf1ed4383aebc14f00a100d2a', 'request_id': 'req-cfb80363-2686-4e9f-863a-08aac865e0e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:06.700707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb0b101bf1ed4383aebc14f00a100d2a', 'request_id': 'req-cfb80363-2686-4e9f-863a-08aac865e0e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:06.714492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb0b101bf1ed4383aebc14f00a100d2a', 'request_id': 'req-cfb80363-2686-4e9f-863a-08aac865e0e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:06.828469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] The token cache is being invalidate because project bb0b101bf1ed4383aebc14f00a100d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:10:06.828469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:06.828469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cfb80363-2686-4e9f-863a-08aac865e0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:06.828469 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 940/1910] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:10:06 2022] DELETE /identity/v3/projects/bb0b101bf1ed4383aebc14f00a100d2a => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:06.829953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:06.830434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:06.830838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:06.883095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:06.883095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:06.992033 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 971/1911] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:06.995577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:06.996363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:06.997006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:07.021123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:07.022737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:07.033066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 941/1912] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:07.036311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:07.048911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76144903-975c-4eee-907b-b526dbd2e710 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:07.054847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:07.055541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:07.055895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:07.056239 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:07.057027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:10:07.057534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:07.060253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:07.076554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 972/1913] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:10:07.126254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:07.136206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be327a31-859b-4a8c-b96e-1ca4241150e0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:07.140960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:07.141573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:07.141855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:07.142130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:07.142776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:07.144768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:07.662279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 942/1914] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:10:07 2022] POST /identity/v3/projects => generated 367 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:10:07.666616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:07.684736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50862-beb0-4c49-8120-6938cfe2e01c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:07.690121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:07.751962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:07.752630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:07.752911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:07.753185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:07.753864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:07.755818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:08.233365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 973/1915] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:10:07 2022] POST /identity/v3/users => generated 284 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:10:08.237462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:08.247627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49eb5-6a1e-4f92-90db-23065506a022 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:08.252467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:08.253065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:08.253341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:08.254199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:08.254846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:08.256460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:08.266327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 943/1916] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:10:08.271021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:08.281421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae31dd-029f-4196-837d-040b4ebad9bc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:08.286497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276824ca-9ec9-4d52-a0d7-a237ae278df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:08.287132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276824ca-9ec9-4d52-a0d7-a237ae278df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:08.288052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276824ca-9ec9-4d52-a0d7-a237ae278df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:08.288052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276824ca-9ec9-4d52-a0d7-a237ae278df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:08.288310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276824ca-9ec9-4d52-a0d7-a237ae278df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:08.298755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276824ca-9ec9-4d52-a0d7-a237ae278df9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:08.304740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 974/1917] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:10:08.306117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:08.318040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24250f3-08ed-4859-a306-0973b2112a7b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:08.324218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:08.325081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:08.325369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:08.328238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] PATH_INFO: `/v3/projects/b1cd56895dd047699d51f7bf26c9bd89/users/40a9bb7468004dc0957eb0162a3cae52/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:08.349532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1cd56895dd047699d51f7bf26c9bd89, user_id=40a9bb7468004dc0957eb0162a3cae52, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:08.352349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:08.418202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 944/1918] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:10:08 2022] PUT /identity/v3/projects/b1cd56895dd047699d51f7bf26c9bd89/users/40a9bb7468004dc0957eb0162a3cae52/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:08.428974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:08.429200 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:08.429425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:08.464248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] MFA Rules not processed for user `40a9bb7468004dc0957eb0162a3cae52`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:08.465668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:08.631603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 975/1919] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:08.644323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:08.646176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:08.663178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:08.765151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f93e97-399a-4cd3-abde-e8c90f300897 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:08.780687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440db482-a435-460a-9df8-9acd36ec8a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:08.781391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db482-a435-460a-9df8-9acd36ec8a30 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:08.781678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db482-a435-460a-9df8-9acd36ec8a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:08.781951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440db482-a435-460a-9df8-9acd36ec8a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:08.800880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440db482-a435-460a-9df8-9acd36ec8a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:08.802602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440db482-a435-460a-9df8-9acd36ec8a30 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:08.824450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 945/1920] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:08.850600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:09.018726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1d063-e7c3-4a28-b14d-032a91b5f6a6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:09.046786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:09.048518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:09.052581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:09.053124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] PATH_INFO: `/v3/users/40a9bb7468004dc0957eb0162a3cae52` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:09.056950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a9bb7468004dc0957eb0162a3cae52)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:09.061906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:09.125478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:09.480729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a9bb7468004dc0957eb0162a3cae52'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:09.489785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a9bb7468004dc0957eb0162a3cae52'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:09.507404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a9bb7468004dc0957eb0162a3cae52'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:09.508211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a9bb7468004dc0957eb0162a3cae52'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:09.587672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a9bb7468004dc0957eb0162a3cae52'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:09.598528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 976/1921] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:10:08 2022] DELETE /identity/v3/users/40a9bb7468004dc0957eb0162a3cae52 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:09.600062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:09.600360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:09.600694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:09.627086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:09.629239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:09.700312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 946/1922] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:09.711415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:09.713396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:09.788286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9f75-12ee-4297-8aec-9f6d968333b9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:09.792035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5ce7c-1542-4979-8f6a-56d4aeafba6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:09.792769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5ce7c-1542-4979-8f6a-56d4aeafba6d service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:09.793109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5ce7c-1542-4979-8f6a-56d4aeafba6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:09.793477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5ce7c-1542-4979-8f6a-56d4aeafba6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:09.803052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5ce7c-1542-4979-8f6a-56d4aeafba6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:09.804982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5ce7c-1542-4979-8f6a-56d4aeafba6d service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:09.815319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 977/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:10.349268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:10.353909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:10.374058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d2ea-45c7-4336-ac16-b37716dc5b7d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:10.380014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555278cd-8789-4353-972c-99300e05533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:10.381086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555278cd-8789-4353-972c-99300e05533c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:10.381513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555278cd-8789-4353-972c-99300e05533c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:10.381928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555278cd-8789-4353-972c-99300e05533c admin admin] PATH_INFO: `/v3/projects/b1cd56895dd047699d51f7bf26c9bd89` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:10.383710 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555278cd-8789-4353-972c-99300e05533c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1cd56895dd047699d51f7bf26c9bd89)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:10.387405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555278cd-8789-4353-972c-99300e05533c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:10.521010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555278cd-8789-4353-972c-99300e05533c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1cd56895dd047699d51f7bf26c9bd89', 'request_id': 'req-555278cd-8789-4353-972c-99300e05533c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:10.529190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555278cd-8789-4353-972c-99300e05533c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1cd56895dd047699d51f7bf26c9bd89', 'request_id': 'req-555278cd-8789-4353-972c-99300e05533c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:10.538988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555278cd-8789-4353-972c-99300e05533c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1cd56895dd047699d51f7bf26c9bd89', 'request_id': 'req-555278cd-8789-4353-972c-99300e05533c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:10.611574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555278cd-8789-4353-972c-99300e05533c admin admin] The token cache is being invalidate because project b1cd56895dd047699d51f7bf26c9bd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:10:10.611900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555278cd-8789-4353-972c-99300e05533c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:10.612585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-555278cd-8789-4353-972c-99300e05533c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:10:10.614550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 947/1924] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:10:10 2022] DELETE /identity/v3/projects/b1cd56895dd047699d51f7bf26c9bd89 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:10.620569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:10.621066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:10.621066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:10.646036 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:10.647743 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:10.717575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 978/1925] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:10:10.727909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:10.728463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:10.728644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:10.754965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:10.756222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:10.767562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 948/1926] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:10.772569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:10.785575 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e89813-136e-4a85-8da0-3f762639e8de None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:10.790125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:10.790819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:10.791174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:10.791526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:10.792252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:10:10.792665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:10.794337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:10.812232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 979/1927] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:10:10.813554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:10.824191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab5df3-22cc-4c71-b95b-0bcff34f2295 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:10.830311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:10.831252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:10.831642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:10.831994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:10.832745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:10.834793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:10.918224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 949/1928] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:10:10 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:10:10.919529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:10.931370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cc97f-7ec7-4e97-b60e-acf913c52224 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:10.959872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:11.003879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:11.004532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:11.004821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:11.005095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:11.005883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:11.007989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:11.132018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 980/1929] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:10:10 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:10:11.133434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:11.141461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:11.146741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4688c-322d-41d6-ad68-7132b721f19f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:11.162912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:11.163551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:11.163835 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:11.164136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:11.165082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:11.166900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:11.182450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 950/1930] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:10:11.186275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:11.198455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305494bf-1740-44bd-8fb4-4a72fd09a157 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:11.211125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f64d74-dc77-4402-9252-a09f90823cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:11.212066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64d74-dc77-4402-9252-a09f90823cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:11.212066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64d74-dc77-4402-9252-a09f90823cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:11.212375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f64d74-dc77-4402-9252-a09f90823cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:11.213170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f64d74-dc77-4402-9252-a09f90823cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:11.214815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f64d74-dc77-4402-9252-a09f90823cbb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:11.233183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 981/1931] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:10:11.234817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:11.246679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd6618-7bb8-4fc7-8d57-1cf949046abc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:11.272994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:11.273681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:11.273961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:11.274403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] PATH_INFO: `/v3/projects/faf6f8c0f3694f42a30232874a142685/users/7175a36794194edba6b16366b0e12a0c/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:11.297468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf6f8c0f3694f42a30232874a142685, user_id=7175a36794194edba6b16366b0e12a0c, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:11.308477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:11.833466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 951/1932] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:10:11 2022] PUT /identity/v3/projects/faf6f8c0f3694f42a30232874a142685/users/7175a36794194edba6b16366b0e12a0c/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:10:11.838490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca2d1c-94b3-410d-ad67-52a5cc574d02 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:11.838929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca2d1c-94b3-410d-ad67-52a5cc574d02 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:11.839024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca2d1c-94b3-410d-ad67-52a5cc574d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:11.861501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-87ca2d1c-94b3-410d-ad67-52a5cc574d02 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:11.862753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-87ca2d1c-94b3-410d-ad67-52a5cc574d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:11.923193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 982/1933] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:11.932377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:11.934118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:11.996784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a759945-3cbf-4076-b7b9-ef98986d750e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:12.003965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c055-77fc-4133-9442-172483110aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:12.004614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c055-77fc-4133-9442-172483110aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:12.004900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c055-77fc-4133-9442-172483110aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:12.005178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c055-77fc-4133-9442-172483110aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:12.015674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c055-77fc-4133-9442-172483110aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:12.017182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c055-77fc-4133-9442-172483110aa0 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:12.028103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 952/1934] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:13.098252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:13.098791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:13.098791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:13.134213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] MFA Rules not processed for user `c79116777e354734b73a0b334fd013c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:13.135470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:13.205024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 983/1935] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:13.747356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bccfa7-39ec-4c91-a447-79c4aa83bfd5 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:13.747905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bccfa7-39ec-4c91-a447-79c4aa83bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:13.747905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bccfa7-39ec-4c91-a447-79c4aa83bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:13.783207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-87bccfa7-39ec-4c91-a447-79c4aa83bfd5 None None] MFA Rules not processed for user `7175a36794194edba6b16366b0e12a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:13.784893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-87bccfa7-39ec-4c91-a447-79c4aa83bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:13.859906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 953/1936] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:13.871408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:13.876988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:13.950556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d86da-0703-4b75-91d1-cb3b8dca67c2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:13.958083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23428c-8c9b-4567-80d1-dae76810ea5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:13.958708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23428c-8c9b-4567-80d1-dae76810ea5b service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:13.958988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23428c-8c9b-4567-80d1-dae76810ea5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:13.960111 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23428c-8c9b-4567-80d1-dae76810ea5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:13.966768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:13.971014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23428c-8c9b-4567-80d1-dae76810ea5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:13.974730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23428c-8c9b-4567-80d1-dae76810ea5b service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:13.982158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 984/1937] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:15.712590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07d2b1-63b9-4d51-8c7b-423c4a9b6b5a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:15.713116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07d2b1-63b9-4d51-8c7b-423c4a9b6b5a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:15.713227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07d2b1-63b9-4d51-8c7b-423c4a9b6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:15.732483 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1a07d2b1-63b9-4d51-8c7b-423c4a9b6b5a None None] MFA Rules not processed for user `7175a36794194edba6b16366b0e12a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:15.733694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1a07d2b1-63b9-4d51-8c7b-423c4a9b6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:15.740938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 954/1938] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:10:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:17.119850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ff16-3c37-4fa9-b7ee-52e2e451b5d1 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.120429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ff16-3c37-4fa9-b7ee-52e2e451b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.129023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ff16-3c37-4fa9-b7ee-52e2e451b5d1 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.129023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 985/1939] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:10:17.129240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42da97-280e-4882-a578-81439a9a0ac9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.129240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42da97-280e-4882-a578-81439a9a0ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.129240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42da97-280e-4882-a578-81439a9a0ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.149011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5e42da97-280e-4882-a578-81439a9a0ac9 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:17.150214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5e42da97-280e-4882-a578-81439a9a0ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:17.200944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:17.220611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 955/1940] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:10:17.232124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ff16-3c37-4fa9-b7ee-52e2e451b5d1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:17.233829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9f53ff16-3c37-4fa9-b7ee-52e2e451b5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:17.292485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ff16-3c37-4fa9-b7ee-52e2e451b5d1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:17.295934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d7e4f-dcda-49b0-ab82-65c2ce9089fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:17.296560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d7e4f-dcda-49b0-ab82-65c2ce9089fa service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.296855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d7e4f-dcda-49b0-ab82-65c2ce9089fa service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.297112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d7e4f-dcda-49b0-ab82-65c2ce9089fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.306940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d7e4f-dcda-49b0-ab82-65c2ce9089fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:17.308408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d7e4f-dcda-49b0-ab82-65c2ce9089fa service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:17.323091 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 986/1941] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:17.573023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06933c-d722-42f8-8e7b-9bcba7bfb97a None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.573357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06933c-d722-42f8-8e7b-9bcba7bfb97a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.573837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06933c-d722-42f8-8e7b-9bcba7bfb97a None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.575178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 956/1942] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:10:17.582040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692bb7-c624-4ccb-a54d-bbe723796a67 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.582345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692bb7-c624-4ccb-a54d-bbe723796a67 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.583126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692bb7-c624-4ccb-a54d-bbe723796a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.608130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-92692bb7-c624-4ccb-a54d-bbe723796a67 None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:17.608819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-92692bb7-c624-4ccb-a54d-bbe723796a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:17.638347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 987/1943] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:17.648221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06933c-d722-42f8-8e7b-9bcba7bfb97a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:17.690350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06933c-d722-42f8-8e7b-9bcba7bfb97a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:17.702675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa782f-cf94-40cd-9d2c-2ae842bea69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:17.703544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa782f-cf94-40cd-9d2c-2ae842bea69d service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.704315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa782f-cf94-40cd-9d2c-2ae842bea69d service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.705180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa782f-cf94-40cd-9d2c-2ae842bea69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.725809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa782f-cf94-40cd-9d2c-2ae842bea69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:17.727414 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa782f-cf94-40cd-9d2c-2ae842bea69d service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:17.738882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 957/1944] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:17.829936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88746b1-2ee0-46b9-b844-cb430ab3db1b None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.830941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88746b1-2ee0-46b9-b844-cb430ab3db1b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.830941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88746b1-2ee0-46b9-b844-cb430ab3db1b None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.832456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 988/1945] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:10:17.838163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6efc-e2c6-4917-80b4-cb3e3cab25d3 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.838453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6efc-e2c6-4917-80b4-cb3e3cab25d3 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.838729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6efc-e2c6-4917-80b4-cb3e3cab25d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.859788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-945c6efc-e2c6-4917-80b4-cb3e3cab25d3 None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:17.861123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-945c6efc-e2c6-4917-80b4-cb3e3cab25d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:17.871477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 958/1946] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:17.882577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88746b1-2ee0-46b9-b844-cb430ab3db1b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:17.884260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f88746b1-2ee0-46b9-b844-cb430ab3db1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:17.897719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88746b1-2ee0-46b9-b844-cb430ab3db1b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:17.901468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:17.902057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:17.902333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:17.902605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:17.913224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:17.914796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:17.925434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 989/1947] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:18.991909 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61afe-5c99-4d38-b2ef-84b8205a0e4b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:18.992836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61afe-5c99-4d38-b2ef-84b8205a0e4b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:18.993182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c61afe-5c99-4d38-b2ef-84b8205a0e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:19.017634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c4c61afe-5c99-4d38-b2ef-84b8205a0e4b None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:19.019173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c4c61afe-5c99-4d38-b2ef-84b8205a0e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:19.080278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 959/1948] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:10:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:19.092806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:19.094400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:19.190689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a946aa-9b1d-4e00-88f4-3be5c2544733 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:19.196899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:19.197609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:19.197961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:19.198307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:19.208195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:19.216315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:19.222116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 990/1949] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:10:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:29.073311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=40 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:29.218761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=70 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:32.844555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:32.845432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:32.845916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:32.868635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:32.869939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:32.879104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 960/1950] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:10:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:10:32.893867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:32.904973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4b508-2d4b-4c35-bc63-1789e5b7d4e5 service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:32.911358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b763f-421d-4556-a1f4-138a314511ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:32.912102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b763f-421d-4556-a1f4-138a314511ca service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:32.912401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b763f-421d-4556-a1f4-138a314511ca service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:32.912695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b763f-421d-4556-a1f4-138a314511ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:32.922307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b763f-421d-4556-a1f4-138a314511ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:32.927366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b763f-421d-4556-a1f4-138a314511ca service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:32.933757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 991/1951] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:10:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:42.864054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:42.929464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:10:51.264246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:51.266045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:51.374140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c3a3f-46f3-4499-9ccc-261295cf51f9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:51.387485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:51.388468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:51.388919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:51.399018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:51.402110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:51.418371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:51.420521 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:51.437351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 961/1952] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:10:53.451258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:53.451757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:53.451963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:53.472071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:10:53.474037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:53.481287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 992/1953] 10.222.0.13 () {58 vars in 967 bytes} [Fri Oct 14 03:10:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:10:53.504473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:53.516252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cafff-2c9c-43f2-82c9-be4d1025914d service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:53.521883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b436f-434e-474d-aa13-84611d448fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:53.522491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b436f-434e-474d-aa13-84611d448fd8 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:53.522772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b436f-434e-474d-aa13-84611d448fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:53.523046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b436f-434e-474d-aa13-84611d448fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:53.531383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b436f-434e-474d-aa13-84611d448fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:53.533001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b436f-434e-474d-aa13-84611d448fd8 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:53.541704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 962/1954] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:10:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:10:58.845978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:10:58.855560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784c565-97d1-4705-afc2-af6bcbb1103e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:10:58.859943 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:10:58.860583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:10:58.860864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:10:58.861136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:10:58.862910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:10:58.932823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:10:58.934476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef606-f13b-481a-9d6b-eaa30b0afee5 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:10:58.945586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 993/1955] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:10:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:11:03.538436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=38 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:08.940357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=33 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:09.510446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:09.514234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:09.514234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:09.530608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] MFA Rules not processed for user `4553b7573ca34af6a9fdb94f80717f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:09.531810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:09.589335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 963/1956] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:11:16.895821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94255-a503-41e5-a2c8-9a550bb8dbd8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:16.896364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94255-a503-41e5-a2c8-9a550bb8dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:16.896497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc94255-a503-41e5-a2c8-9a550bb8dbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:16.915972 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-fdc94255-a503-41e5-a2c8-9a550bb8dbd8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:16.917199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fdc94255-a503-41e5-a2c8-9a550bb8dbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:16.924997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 994/1957] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:11:16.946112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:11:16.947549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:16.963851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a173ebf-c8d7-4927-8e27-6bee1a023496 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:11:16.969309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:11:16.969908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:16.970185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:16.970455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:16.978493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:11:16.980560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:11:16.990028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 964/1958] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:11:22.326668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6cf2-540e-4c78-82c6-713f74829407 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:22.327149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6cf2-540e-4c78-82c6-713f74829407 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:22.327268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea6cf2-540e-4c78-82c6-713f74829407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:22.347530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-27ea6cf2-540e-4c78-82c6-713f74829407 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:22.348790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-27ea6cf2-540e-4c78-82c6-713f74829407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:22.356645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 995/1959] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:11:22.380748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:11:22.391949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fc45-1cfa-4d90-a6be-46ad11397e56 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:11:22.397837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:11:22.400319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:22.400319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:22.400319 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:22.406868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:11:22.409041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:11:22.418306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 965/1960] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:11:27.761327 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5cfed-681d-461e-b177-40aca9be898f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:27.761896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5cfed-681d-461e-b177-40aca9be898f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:27.761896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5cfed-681d-461e-b177-40aca9be898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:27.782861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e3d5cfed-681d-461e-b177-40aca9be898f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:27.784081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e3d5cfed-681d-461e-b177-40aca9be898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:27.792105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 996/1961] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:11:27.829520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:11:27.841621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19512a2a-8d2a-4002-a89c-2e0cec0fa98f service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:11:27.847263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775a440-b0fd-4505-aa53-a9d06789aaa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:11:27.849724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a440-b0fd-4505-aa53-a9d06789aaa9 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:27.849724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a440-b0fd-4505-aa53-a9d06789aaa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:27.849724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775a440-b0fd-4505-aa53-a9d06789aaa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:27.859250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775a440-b0fd-4505-aa53-a9d06789aaa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:11:27.860959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775a440-b0fd-4505-aa53-a9d06789aaa9 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:11:27.871691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 966/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:11:30.736117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:30.736694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:30.736694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:30.755073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] MFA Rules not processed for user `dbf0723a0f3942d2b9b2554320878016`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:30.760304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:30.811758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 997/1963] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:11:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:11:31.745547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e393c-1b7e-4ca8-aed4-d90d87e5c3c6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:31.746010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e393c-1b7e-4ca8-aed4-d90d87e5c3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:31.746187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e393c-1b7e-4ca8-aed4-d90d87e5c3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:31.766764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ee7e393c-1b7e-4ca8-aed4-d90d87e5c3c6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:31.767906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ee7e393c-1b7e-4ca8-aed4-d90d87e5c3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:31.775886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 967/1964] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:11:31.801830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:11:31.803452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:31.820516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa986a20-1a8d-423f-ac52-44f517315c8f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:11:31.826711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:11:31.827410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:31.827764 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:31.828109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:31.837537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:11:31.839345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:11:31.849626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 998/1965] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:11:37.011777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bda7e-d895-44e6-8bc4-1989413f4013 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:37.012241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bda7e-d895-44e6-8bc4-1989413f4013 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:37.012500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bda7e-d895-44e6-8bc4-1989413f4013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:37.020888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=47 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:37.033758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-624bda7e-d895-44e6-8bc4-1989413f4013 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:37.034975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-624bda7e-d895-44e6-8bc4-1989413f4013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:37.043273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 968/1966] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:11:37.067359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:11:37.080143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d50bb-dd85-4778-9d9d-42ab7fd83ae9 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:11:37.086264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:11:37.086976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:37.087256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:37.087526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:37.097103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:11:37.098711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:11:37.109439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 999/1967] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:11:41.299171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e27ac-f463-4617-a5e9-a134fb59bd0a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:41.299703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e27ac-f463-4617-a5e9-a134fb59bd0a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:41.299818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e27ac-f463-4617-a5e9-a134fb59bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:41.319848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-348e27ac-f463-4617-a5e9-a134fb59bd0a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:11:41.321078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-348e27ac-f463-4617-a5e9-a134fb59bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:11:41.328895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 969/1968] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:11:41.356877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:11:41.362476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=47 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:41.368232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602a250-7720-458d-9e91-3a267a5a7b19 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:11:41.374571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833fbd6-9319-4ca1-b50d-89cb29a0d791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:11:41.375165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833fbd6-9319-4ca1-b50d-89cb29a0d791 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:11:41.375446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833fbd6-9319-4ca1-b50d-89cb29a0d791 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:11:41.375721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833fbd6-9319-4ca1-b50d-89cb29a0d791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:11:41.383815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833fbd6-9319-4ca1-b50d-89cb29a0d791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:11:41.385434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833fbd6-9319-4ca1-b50d-89cb29a0d791 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:11:41.395118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1000/1969] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:11:51.315085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:11:51.391513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:02.440596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096945c-2e1f-48be-92f9-8ddac0db7a35 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:02.441068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096945c-2e1f-48be-92f9-8ddac0db7a35 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:02.441190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096945c-2e1f-48be-92f9-8ddac0db7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:02.460203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b096945c-2e1f-48be-92f9-8ddac0db7a35 None None] MFA Rules not processed for user `1201fb5f14154b048f5c55bd566e91b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:02.461438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b096945c-2e1f-48be-92f9-8ddac0db7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:02.515547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 970/1970] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:12:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:02.931613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dcb13-b505-46cb-9775-2944a40fb1b4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:02.932153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dcb13-b505-46cb-9775-2944a40fb1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:02.932305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dcb13-b505-46cb-9775-2944a40fb1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:02.951169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-707dcb13-b505-46cb-9775-2944a40fb1b4 None None] MFA Rules not processed for user `7175a36794194edba6b16366b0e12a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:02.952413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-707dcb13-b505-46cb-9775-2944a40fb1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:02.959229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1001/1971] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:12:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:11.347952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:11.348510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:11.348606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:11.367509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] MFA Rules not processed for user `2c196d842c4540b5800b4efa0ec4fc73`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:11.368712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:11.425379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 971/1972] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:12:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:12.947646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:21.418229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=50 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:30.587282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:30.587896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:30.588787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:30.613542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:30.615235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:30.625824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1002/1973] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:30.713265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:30.728934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0a897-ce6b-448c-915e-e3c9837ebb47 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:30.734498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:30.735149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:30.735496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:30.735766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:30.744793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:30.746394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:30.756598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 972/1974] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:31.857336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:31.870990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f652c1-0ed2-41d0-96d3-6f226fadf7e2 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:31.877164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:31.880937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:31.880937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:31.880937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:31.881947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:31.914507 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:31.914507 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a19c1-9cad-4386-8077-e401f0158c5e service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:31.930928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1003/1975] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:34.218647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:34.230975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c744-5dc9-451f-a8b6-0938f303c61e service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:34.236210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:34.236864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:34.237314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:34.237743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:34.239872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:34.257467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:34.259101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:34.275050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 973/1976] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:12:35.215705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26781b-23b5-4155-82fc-deb7b1384da1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:35.216285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26781b-23b5-4155-82fc-deb7b1384da1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:35.216285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26781b-23b5-4155-82fc-deb7b1384da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:35.235727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cf26781b-23b5-4155-82fc-deb7b1384da1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:35.237573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cf26781b-23b5-4155-82fc-deb7b1384da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:35.246899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1004/1977] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:35.267823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:35.279340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dfa1d-cbcf-4b18-82aa-0e6124d180f9 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:35.285615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5c1a-55fb-4855-89d1-0bd846d87d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:35.286219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5c1a-55fb-4855-89d1-0bd846d87d60 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:35.286496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5c1a-55fb-4855-89d1-0bd846d87d60 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:35.286767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5c1a-55fb-4855-89d1-0bd846d87d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:35.295278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add5c1a-55fb-4855-89d1-0bd846d87d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:35.296889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add5c1a-55fb-4855-89d1-0bd846d87d60 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:35.307459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 974/1978] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:38.279878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:38.280431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:38.280605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:38.300638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] MFA Rules not processed for user `4553b7573ca34af6a9fdb94f80717f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:38.301855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:38.308628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1005/1979] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:12:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:39.136491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfef144-2335-4fd8-8eae-85307218e813 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:39.136967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfef144-2335-4fd8-8eae-85307218e813 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:39.137063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfef144-2335-4fd8-8eae-85307218e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:39.156513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fcfef144-2335-4fd8-8eae-85307218e813 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:39.157700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fcfef144-2335-4fd8-8eae-85307218e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:39.166191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 975/1980] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:39.191044 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:39.204628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c0b10-8b78-48f9-8cf3-be0fa6c73093 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:39.211848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:39.212502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:39.213328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:39.213877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:39.223918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:39.225536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:39.235461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1006/1981] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:12:45.460862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:45.461434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:45.461753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:45.483596 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:45.484836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:45.493843 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 976/1982] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:45.524383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:45.538514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5af0b7-1494-4d01-a067-44e18b4db427 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:45.542431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:45.543259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:45.543717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:45.544156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:45.554348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:45.556137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:45.569395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1007/1983] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:50.360266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:50.370383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d23326-2c01-4a5e-8ace-4ecf8773b8fd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:50.374143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:50.374741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:50.375036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:50.375294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:50.377180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:50.387683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:50.389134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896e7d7-22cc-44c3-9817-508b38b4e17c service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:50.397891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 977/1984] 10.222.0.13 () {60 vars in 1396 bytes} [Fri Oct 14 03:12:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:52.590797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:52.600838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0234-e772-48ba-9a73-ab1c52607012 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:52.605714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:52.605714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:52.606129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:52.606410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:52.608342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:52.624493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:52.624867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:52.635305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1008/1985] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:53.831856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:53.832305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:53.832468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:53.840032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=31 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:53.852184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:12:53.853424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:53.862286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 978/1986] 10.222.0.44 () {58 vars in 1016 bytes} [Fri Oct 14 03:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:12:53.887847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:53.894703 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=34 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:12:53.900997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad54268-5ac4-4671-9a87-3f9e08ccf384 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:53.906876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268952-b370-4913-9512-81a71bf3776e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:53.907487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268952-b370-4913-9512-81a71bf3776e service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:53.907770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268952-b370-4913-9512-81a71bf3776e service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:53.908046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33268952-b370-4913-9512-81a71bf3776e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:53.916795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33268952-b370-4913-9512-81a71bf3776e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:53.918425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33268952-b370-4913-9512-81a71bf3776e service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:53.929156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1009/1987] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:57.367127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:57.378595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0f0be-1ff5-4073-9e1a-00c7b651683f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:57.382766 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:57.383425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:57.383775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:57.384123 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:57.385979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:57.398539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:57.399973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba85bd5-c176-453a-8d64-2a9608441ea7 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:57.410489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 979/1988] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:12:59.057534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268952-b370-4913-9512-81a71bf3776e service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:12:59.067594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33268952-b370-4913-9512-81a71bf3776e service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:12:59.071449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:12:59.072316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:12:59.072850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:12:59.073157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:12:59.074954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:12:59.085713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:12:59.087321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ed15a-a077-4dd5-841b-29c23a5f56b1 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:12:59.097720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1010/1989] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:12:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:01.853447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257a861-ee25-4a7f-b2be-1e8fbf750486 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:01.854079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257a861-ee25-4a7f-b2be-1e8fbf750486 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:01.854079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257a861-ee25-4a7f-b2be-1e8fbf750486 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:01.856310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 980/1990] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:13:01.898707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:01.899167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:01.899387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:01.928047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] MFA Rules not processed for user `75afccceda7e4c1692631acb70edce96`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:01.929586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:01.939996 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1011/1991] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:13:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:01.965118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257a861-ee25-4a7f-b2be-1e8fbf750486 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:01.969033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3257a861-ee25-4a7f-b2be-1e8fbf750486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:01.984540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257a861-ee25-4a7f-b2be-1e8fbf750486 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:01.989879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:01.990746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:01.991030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:01.991522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:02.001161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:02.002781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:02.013071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 981/1992] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:02.071642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:02.073211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:02.090709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1e11e-b44d-4bff-bcb1-18fe36501925 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:02.095911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:02.096811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:02.097097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:02.097376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] PATH_INFO: `/v3/users/dbf0723a0f3942d2b9b2554320878016` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:02.098546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf0723a0f3942d2b9b2554320878016)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:02.100532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:02.248965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf0723a0f3942d2b9b2554320878016'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.264336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf0723a0f3942d2b9b2554320878016'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.286993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf0723a0f3942d2b9b2554320878016'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.288882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf0723a0f3942d2b9b2554320878016'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.357302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-e4103a61-06d4-44a7-bb2b-f2b844ee65a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf0723a0f3942d2b9b2554320878016'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.368594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1012/1993] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:02 2022] DELETE /identity/v3/users/dbf0723a0f3942d2b9b2554320878016 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:02.684978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:02.699958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a4e-759e-40c2-9576-b260de5721dc service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:02.764679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:02.765339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:02.765620 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:02.765895 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] PATH_INFO: `/v3/projects/61f89b8e68d14d3d96fa84ab1697fcea` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:02.767083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f89b8e68d14d3d96fa84ab1697fcea)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:02.769076 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:02.877978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f89b8e68d14d3d96fa84ab1697fcea', 'request_id': 'req-f99d3a6f-7932-4959-b9ff-ec0e55535086'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.884089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f89b8e68d14d3d96fa84ab1697fcea', 'request_id': 'req-f99d3a6f-7932-4959-b9ff-ec0e55535086'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.892008 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f89b8e68d14d3d96fa84ab1697fcea', 'request_id': 'req-f99d3a6f-7932-4959-b9ff-ec0e55535086'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.950852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] The token cache is being invalidate because project 61f89b8e68d14d3d96fa84ab1697fcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:02.951164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.951831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f99d3a6f-7932-4959-b9ff-ec0e55535086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:02.953400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 982/1994] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:02 2022] DELETE /identity/v3/projects/61f89b8e68d14d3d96fa84ab1697fcea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:02.958435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:02.958945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:02.959032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:02.979361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:02.981167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:03.041794 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1013/1995] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:13:03.049995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.050288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.050568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.072047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:03.073376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:03.081361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 983/1996] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:13:03.085850 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.096363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edfe4d-83b7-44ca-997d-91a20e360439 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.101694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.102313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.102594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.102870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.103528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:13:03.103832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.106064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.118479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1014/1997] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:13:03.123659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.133484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268a85d-fa87-4fba-96b1-08417b84248d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.138349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.138959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.139242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.139515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.140160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.142115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.231769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 984/1998] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:03 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:13:03.235884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.259648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35e564-00e3-41ec-82e5-921942681031 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.291941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:03.323706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.324345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.324651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.324926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.325613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.327587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.393635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1015/1999] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:03 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:13:03.394874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.406586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2a9e0-7301-4479-9b1e-d3d2b1e709c2 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.411555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.412344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.412745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.413092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.413808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.415491 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.429536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 985/2000] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:03.430927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.441137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543b92d-5dbc-47fa-9d3c-f3c6ceae7f9a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.445640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae410a8b-85d8-4cef-9fb1-157b566a994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.446235 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae410a8b-85d8-4cef-9fb1-157b566a994d admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.446514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae410a8b-85d8-4cef-9fb1-157b566a994d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.446787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae410a8b-85d8-4cef-9fb1-157b566a994d admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.447429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae410a8b-85d8-4cef-9fb1-157b566a994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.449088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae410a8b-85d8-4cef-9fb1-157b566a994d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.458990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1016/2001] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:03.463102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.474619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580cf2-dde7-4f9e-9f0c-110c13aad037 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.479952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.481505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.481934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.482307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] PATH_INFO: `/v3/projects/2e229b5e4a3448fab14d3972ff247a14/users/83b3009fba0d49768891fe692f7da1c8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.499385 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e229b5e4a3448fab14d3972ff247a14, user_id=83b3009fba0d49768891fe692f7da1c8, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.503198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.506510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:03.579628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 986/2002] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:03 2022] PUT /identity/v3/projects/2e229b5e4a3448fab14d3972ff247a14/users/83b3009fba0d49768891fe692f7da1c8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:03.591530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.591883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.592161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.623480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] MFA Rules not processed for user `83b3009fba0d49768891fe692f7da1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:03.624599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:03.702339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1017/2003] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:03.713655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:03.715985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:03.792629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e5547-423e-45ba-87a8-2d2dcad7e312 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:03.798271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f61f-d9f8-4a80-aec1-d07f350dccbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:03.798867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f61f-d9f8-4a80-aec1-d07f350dccbc service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:03.799152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f61f-d9f8-4a80-aec1-d07f350dccbc service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:03.799429 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f61f-d9f8-4a80-aec1-d07f350dccbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:03.807574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f61f-d9f8-4a80-aec1-d07f350dccbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:03.809771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f61f-d9f8-4a80-aec1-d07f350dccbc service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:03.819438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 987/2004] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:04.040940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:04.104428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214de1ca-49b5-45a4-8ea9-ef5609c43d77 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:04.108910 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:04.109544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:04.109833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:04.110096 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] PATH_INFO: `/v3/users/83b3009fba0d49768891fe692f7da1c8` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:04.111234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b3009fba0d49768891fe692f7da1c8)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:04.113217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:04.295752 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:04.302159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b3009fba0d49768891fe692f7da1c8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:04.309833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b3009fba0d49768891fe692f7da1c8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:04.321418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b3009fba0d49768891fe692f7da1c8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:04.322080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b3009fba0d49768891fe692f7da1c8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:04.394789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b3009fba0d49768891fe692f7da1c8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:04.401491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1018/2005] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:04 2022] DELETE /identity/v3/users/83b3009fba0d49768891fe692f7da1c8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:04.406816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:04.407289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:04.407386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:04.426952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:04.427598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:04.488500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 988/2006] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:04.498820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:04.500252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:04.556371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1c15d-b72f-4dab-9afe-3dc459ef99aa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:04.560710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595edfde-b884-4bc3-8317-c2d1bb79ddcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:04.561311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595edfde-b884-4bc3-8317-c2d1bb79ddcb service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:04.561593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595edfde-b884-4bc3-8317-c2d1bb79ddcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:04.561869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595edfde-b884-4bc3-8317-c2d1bb79ddcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:04.570729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595edfde-b884-4bc3-8317-c2d1bb79ddcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:04.572178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595edfde-b884-4bc3-8317-c2d1bb79ddcb service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:04.581923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1019/2007] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:13:04.986873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:04.991573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:05.000838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf61064-b1a6-44ed-bc1c-11ea6ac5c44d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.006690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.007357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.007666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.007943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] PATH_INFO: `/v3/projects/2e229b5e4a3448fab14d3972ff247a14` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.009098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e229b5e4a3448fab14d3972ff247a14)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.011128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.093189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e229b5e4a3448fab14d3972ff247a14', 'request_id': 'req-3c345721-9cce-41da-81a0-995bfcabc55b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:05.098757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e229b5e4a3448fab14d3972ff247a14', 'request_id': 'req-3c345721-9cce-41da-81a0-995bfcabc55b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:05.104848 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e229b5e4a3448fab14d3972ff247a14', 'request_id': 'req-3c345721-9cce-41da-81a0-995bfcabc55b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:05.173120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] The token cache is being invalidate because project 2e229b5e4a3448fab14d3972ff247a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:05.173341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:05.173985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-3c345721-9cce-41da-81a0-995bfcabc55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:05.175571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 989/2008] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:04 2022] DELETE /identity/v3/projects/2e229b5e4a3448fab14d3972ff247a14 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:05.180535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.180995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.181107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.200490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:05.201699 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:05.261329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1020/2009] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:05.269635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.269920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.270194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.279208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:05.290199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:05.291399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:05.299229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 990/2010] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:05.303619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.312957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679f81b-9a4c-4540-8fae-de526a5e21ac None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.317485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.318079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.318358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.318630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.319268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:13:05.319567 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.321191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.333022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1021/2011] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:13:05.337291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.346901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25ad63-af6a-4a49-a5a7-6b05cdcd4330 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.352005 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.352624 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.352912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.353185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.353816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.355716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.448920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 991/2012] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:05 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:05.453188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.463126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b713d4-b63f-419d-97c7-c03fa461c0ab admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.506919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:05.522954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.523566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.523851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.524132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.525191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.526961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.596719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1022/2013] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:05 2022] POST /identity/v3/users => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:05.600868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.611625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675661b-9670-47d5-a5c8-3f344d482df9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.616244 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.616884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.617162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.617433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.618119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.619699 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.630585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 992/2014] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:05.634453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.644458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474ea9a-efab-4148-9e7f-06b767a30abd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.649077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee496c7-cc91-4857-bdf6-e4e003b268f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.649667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee496c7-cc91-4857-bdf6-e4e003b268f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.649963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee496c7-cc91-4857-bdf6-e4e003b268f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.650215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee496c7-cc91-4857-bdf6-e4e003b268f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.650886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee496c7-cc91-4857-bdf6-e4e003b268f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.652492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee496c7-cc91-4857-bdf6-e4e003b268f2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.663687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1023/2015] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:13:05.667758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.678214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3a74e-d7ea-4816-8afb-a412f68fa971 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.683040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.683725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.684006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.684306 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] PATH_INFO: `/v3/projects/78957d5670ee40d3980834888e23d4b8/users/9622acd72b714a5ab654ab3f25042ae7/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.698644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78957d5670ee40d3980834888e23d4b8, user_id=9622acd72b714a5ab654ab3f25042ae7, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.701417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:05.786169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 993/2016] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:05 2022] PUT /identity/v3/projects/78957d5670ee40d3980834888e23d4b8/users/9622acd72b714a5ab654ab3f25042ae7/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:05.792647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6dd9-ad6f-4987-bd4d-88f7824dd3cd None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.792938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6dd9-ad6f-4987-bd4d-88f7824dd3cd None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.793218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6dd9-ad6f-4987-bd4d-88f7824dd3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.813792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-908b6dd9-ad6f-4987-bd4d-88f7824dd3cd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:05.814992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-908b6dd9-ad6f-4987-bd4d-88f7824dd3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:05.874772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1024/2017] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:05.884815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:05.886672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:05.947345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e076-e869-40c7-949d-2f2dfaf598c1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:05.951851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:05.952721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:05.952850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:05.953184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:05.983470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:05.985816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:06.002071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 994/2018] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:08.090595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.091115 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.091212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.119893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] MFA Rules not processed for user `9622acd72b714a5ab654ab3f25042ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:08.121147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:08.195512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1025/2019] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:08 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:13:08.200193 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:08.211579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4d7b7-9745-417c-94c4-44b7e7071d21 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:08.216500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:08.217120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.217402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.217673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.218321 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:08.220274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:08.320207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:08.326102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 995/2020] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:08 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:08.349445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6391b-c6cc-47cb-bca8-8fbbf0ba623a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:08.397147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:08.403804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:08.404606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.404964 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.405188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.405835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:08.407763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:08.489419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1026/2021] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:08 2022] POST /identity/v3/users => generated 309 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:08.493659 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:08.510419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e651a4e-f38e-400b-b4e1-f3811c8a934d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:08.510698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:08.511402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.511745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.512101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.512844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:08.514528 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:08.527103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 996/2022] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:08.531052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:08.541306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972ba9b-a36d-4394-8f13-022d474b979d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:08.547790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:08.548552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.548897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.549237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] PATH_INFO: `/v3/projects/0fab8ef34ccb4a76aa0032d4461257da/users/0f78ef25c3434980bfa2bedba685d451/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.565326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fab8ef34ccb4a76aa0032d4461257da, user_id=0f78ef25c3434980bfa2bedba685d451, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:08.568253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:08.637611 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1027/2023] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:08 2022] PUT /identity/v3/projects/0fab8ef34ccb4a76aa0032d4461257da/users/0f78ef25c3434980bfa2bedba685d451/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:08.641533 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:08.651591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb773cf0-1f67-404e-ae58-f83b759ef1a5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:08.709036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514a35-ee08-46f6-a53c-21a9800eb197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:08.709653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514a35-ee08-46f6-a53c-21a9800eb197 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.709941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514a35-ee08-46f6-a53c-21a9800eb197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.710218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514a35-ee08-46f6-a53c-21a9800eb197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.710899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514a35-ee08-46f6-a53c-21a9800eb197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:08.712508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514a35-ee08-46f6-a53c-21a9800eb197 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:08.726300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 997/2024] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:08.727456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:08.738469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aabca-1b95-4fbd-8726-2f376e552f9c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:08.743355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:08.744114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:08.744438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:08.744727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] PATH_INFO: `/v3/projects/0fab8ef34ccb4a76aa0032d4461257da/users/0f78ef25c3434980bfa2bedba685d451/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:08.747433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fab8ef34ccb4a76aa0032d4461257da, user_id=0f78ef25c3434980bfa2bedba685d451, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:08.750163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:08.762166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1028/2025] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:08 2022] PUT /identity/v3/projects/0fab8ef34ccb4a76aa0032d4461257da/users/0f78ef25c3434980bfa2bedba685d451/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:10.095869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:10.096344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:10.096557 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:10.110546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:10.127028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] MFA Rules not processed for user `0f78ef25c3434980bfa2bedba685d451`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:10.128665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:10.209165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 998/2026] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:11.271103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:11.274479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:11.359758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9c737-a527-4e11-b5dc-bdef42ae53df admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:11.370843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:11.371571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:11.371926 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:11.372270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:11.374644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:11.442004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:11.449894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:11.453891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1029/2027] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:11.638194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:11.641500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:11.662099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4832bd-d835-4a40-9edf-0f8de332f73b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:11.667873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:11.668545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:11.668832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:11.669118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:11.670997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:11.683665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:11.685299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:11.696545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 999/2028] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:11.945384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:12.008140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:12.033536 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79cca3-4b5a-4db8-82e8-1dc8f88f5caf service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:12.046759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:12.047428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:12.047707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:12.047982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] PATH_INFO: `/v3/users/9622acd72b714a5ab654ab3f25042ae7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:12.049352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9622acd72b714a5ab654ab3f25042ae7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:12.051316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:12.294767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9622acd72b714a5ab654ab3f25042ae7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.303146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9622acd72b714a5ab654ab3f25042ae7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.317715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9622acd72b714a5ab654ab3f25042ae7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.318512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9622acd72b714a5ab654ab3f25042ae7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.387704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9622acd72b714a5ab654ab3f25042ae7'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.398009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1030/2029] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:11 2022] DELETE /identity/v3/users/9622acd72b714a5ab654ab3f25042ae7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:12.674847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:12.686206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301764fe-9b64-4af7-ac8c-8e4e75b25d9d service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:12.746205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:12.746826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:12.747105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:12.747377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] PATH_INFO: `/v3/projects/78957d5670ee40d3980834888e23d4b8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:12.748510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78957d5670ee40d3980834888e23d4b8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:12.750432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:12.895564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78957d5670ee40d3980834888e23d4b8', 'request_id': 'req-410028ee-f457-4ad1-8601-d536ccbfdf66'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.906465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78957d5670ee40d3980834888e23d4b8', 'request_id': 'req-410028ee-f457-4ad1-8601-d536ccbfdf66'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.915301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78957d5670ee40d3980834888e23d4b8', 'request_id': 'req-410028ee-f457-4ad1-8601-d536ccbfdf66'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.985800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] The token cache is being invalidate because project 78957d5670ee40d3980834888e23d4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:12.986140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.986801 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-410028ee-f457-4ad1-8601-d536ccbfdf66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:12.988323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1000/2030] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:12 2022] DELETE /identity/v3/projects/78957d5670ee40d3980834888e23d4b8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:12.992350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:12.993801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:13.007081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a739b15-4d02-415c-ad59-a1c5f13c84f7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:13.064752 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:13.065243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:13.065548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:13.065933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] PATH_INFO: `/v3/users/0f78ef25c3434980bfa2bedba685d451` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:13.067268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f78ef25c3434980bfa2bedba685d451)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:13.069230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:13.255742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f78ef25c3434980bfa2bedba685d451'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:13.263024 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f78ef25c3434980bfa2bedba685d451'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:13.271186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:13.276470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f78ef25c3434980bfa2bedba685d451'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:13.277198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f78ef25c3434980bfa2bedba685d451'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:13.368790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f78ef25c3434980bfa2bedba685d451'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:13.376016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1031/2031] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:12 2022] DELETE /identity/v3/users/0f78ef25c3434980bfa2bedba685d451 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:13.771878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:13.772763 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:13.773104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:13.793097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:13.794308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:13.799049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:13.846890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:13.851108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:13.856204 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1001/2032] 10.222.0.13 () {58 vars in 967 bytes} [Fri Oct 14 03:13:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:13.933181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478c1fe-11bc-4fe3-a52d-81301c49e174 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:13.938973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:13.939862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:13.939961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:13.940266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] PATH_INFO: `/v3/projects/0fab8ef34ccb4a76aa0032d4461257da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:13.941579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fab8ef34ccb4a76aa0032d4461257da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:13.943493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:14.091872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:14.091872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:14.113005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fab8ef34ccb4a76aa0032d4461257da', 'request_id': 'req-0cae24bf-05e8-4245-96f9-190490059a5e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:14.125503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fab8ef34ccb4a76aa0032d4461257da', 'request_id': 'req-0cae24bf-05e8-4245-96f9-190490059a5e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:14.171903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27daa79-1dc0-4497-b995-ae243a3a81be None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:14.231059 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d03184-0102-4483-a84d-2b49cc458a5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:14.231657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03184-0102-4483-a84d-2b49cc458a5c service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.231935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03184-0102-4483-a84d-2b49cc458a5c service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.232207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d03184-0102-4483-a84d-2b49cc458a5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.287295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d03184-0102-4483-a84d-2b49cc458a5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:14.288910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d03184-0102-4483-a84d-2b49cc458a5c service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:14.292284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:14.297236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1002/2033] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 03:13:14.386482 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fab8ef34ccb4a76aa0032d4461257da', 'request_id': 'req-0cae24bf-05e8-4245-96f9-190490059a5e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:14.399798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] The token cache is being invalidate because project 0fab8ef34ccb4a76aa0032d4461257da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:14.400092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:14.400817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0cae24bf-05e8-4245-96f9-190490059a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:14.402559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1032/2034] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:13 2022] DELETE /identity/v3/projects/0fab8ef34ccb4a76aa0032d4461257da => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:14.408107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.415158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.415158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.431242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:14.432623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:14.513660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1003/2035] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:14.522041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.544512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.544512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.545736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:14.546991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:14.555720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1033/2036] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:14.560095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:14.570125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c90ba3-2e50-47fa-a2c9-368f1c8b3aeb None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:14.578107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:14.578107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.578107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.578107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.578512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:13:14.578512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:14.578987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:14.591184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1004/2037] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:13:14.597637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:14.632218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94fc40-0436-4c82-986a-a7f679ab6a36 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:14.635763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:14.636373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.636960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.637217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.637786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:14.640884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:14.743589 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1034/2038] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:14.747780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:14.758908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507143a6-cc18-41ff-9bd6-730ed28bf710 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:14.817779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:14.818390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.818671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.819034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.819711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:14.821678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:14.958871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1005/2039] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:14 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:14.963054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:14.973267 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5392d-6bc1-45b2-a2d1-434699207b6c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:14.977761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:14.978346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:14.978622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:14.978892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:14.979525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:14.981270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:14.991748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1035/2040] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:14.995886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.007082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745f92-c57b-43ce-9402-61277a15ab31 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.011735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbdc1f-b6bd-44b1-a7db-b9322700c112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.012348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbdc1f-b6bd-44b1-a7db-b9322700c112 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.012657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbdc1f-b6bd-44b1-a7db-b9322700c112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.012934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbdc1f-b6bd-44b1-a7db-b9322700c112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.013582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbdc1f-b6bd-44b1-a7db-b9322700c112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.015532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbdc1f-b6bd-44b1-a7db-b9322700c112 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.026524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1006/2041] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:13:15.030677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.040851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae880b-ca2d-4948-b7bb-58cb172cd87e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.045464 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.046110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.046934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.047215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] PATH_INFO: `/v3/projects/c30e57903d5a4b188d421a3668840ba2/users/05c47ba246d74df6ba1998162a93f251/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.061659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30e57903d5a4b188d421a3668840ba2, user_id=05c47ba246d74df6ba1998162a93f251, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.066537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.182747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1036/2042] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:15 2022] PUT /identity/v3/projects/c30e57903d5a4b188d421a3668840ba2/users/05c47ba246d74df6ba1998162a93f251/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:15.195120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.195410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.195688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.223014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] MFA Rules not processed for user `05c47ba246d74df6ba1998162a93f251`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:15.224219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:15.278240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:15.288700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1007/2043] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:15.293214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.303920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:15.356013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72c92-b2db-43ba-942e-64a1972e6c92 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.361292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.361890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.362168 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.362442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.363084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.365092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.469977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1037/2044] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:15 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:15.477832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.489053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6214-8867-4a2f-9abf-ee4b7141d19f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.554063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.554689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.554969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.555241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.555898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.557884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.674261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1008/2045] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:15 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:15.675265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.686825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c453613-8af1-4618-8ebd-5870bb62a1a4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.701011 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.701845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.702281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.702724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.703538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.705796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.719268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1038/2046] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:13:15.723380 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.735782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fbfe9-2d93-47f9-9dd9-860985292589 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.741310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.742169 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.742626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.743063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] PATH_INFO: `/v3/projects/922347ce66bf422eaa8c883075068836/users/ada8c8d588a443e2b8556e06fd797514/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.761450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922347ce66bf422eaa8c883075068836, user_id=ada8c8d588a443e2b8556e06fd797514, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.764786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.869348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1009/2047] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:15 2022] PUT /identity/v3/projects/922347ce66bf422eaa8c883075068836/users/ada8c8d588a443e2b8556e06fd797514/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:15.873444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.884210 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24346-a7c6-44ac-b7b8-e695950f1951 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.942523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0becbf-ea3c-4e03-96c0-c4e238bf2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.943129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0becbf-ea3c-4e03-96c0-c4e238bf2cda admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.943412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0becbf-ea3c-4e03-96c0-c4e238bf2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.943687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0becbf-ea3c-4e03-96c0-c4e238bf2cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.944333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0becbf-ea3c-4e03-96c0-c4e238bf2cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.945971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0becbf-ea3c-4e03-96c0-c4e238bf2cda admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.959638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1039/2048] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:13:15.960806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:15.972067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeb4d2-dafb-499d-9608-75aab7ac4fc8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:15.977362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:15.977980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:15.978268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:15.978547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] PATH_INFO: `/v3/projects/922347ce66bf422eaa8c883075068836/users/ada8c8d588a443e2b8556e06fd797514/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:15.980796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922347ce66bf422eaa8c883075068836, user_id=ada8c8d588a443e2b8556e06fd797514, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:15.983520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:15.994585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1010/2049] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:15 2022] PUT /identity/v3/projects/922347ce66bf422eaa8c883075068836/users/ada8c8d588a443e2b8556e06fd797514/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:16.005829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:16.006117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:16.006393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:16.037061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] MFA Rules not processed for user `ada8c8d588a443e2b8556e06fd797514`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:16.040170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:16.111630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1040/2050] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:16.123316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:16.125682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:16.188482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffba6a4-bbb4-454a-9aa7-e8bd023c4212 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:16.192153 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:16.192826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:16.193107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:16.193381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:16.202600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:16.204634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:16.214607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1011/2051] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:16.450848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:16.461034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:16.461034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8380f2f-c3bd-41d8-b69d-b00439b8a6cb None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:16.464712 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:16.465309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:16.465588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:16.465861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:16.529017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:16.536010 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:16.540740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1041/2052] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:20.194637 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:20.196090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:20.249023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:20.276542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e43554-15e1-4ac9-a123-3249ad476043 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:20.282126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:20.283233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:20.283513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:20.283786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:20.285931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:20.344251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:20.346448 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:20.356074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1012/2053] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:23.681220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:23.682781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:23.749770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aeaef-011e-411a-9d21-9e33d6dc647e service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:23.754804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:23.755444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:23.755714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:23.755991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] PATH_INFO: `/v3/users/c79116777e354734b73a0b334fd013c9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:23.757395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79116777e354734b73a0b334fd013c9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:23.759321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:23.997663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79116777e354734b73a0b334fd013c9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.005258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79116777e354734b73a0b334fd013c9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.017399 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79116777e354734b73a0b334fd013c9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.018075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79116777e354734b73a0b334fd013c9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.103156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79116777e354734b73a0b334fd013c9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.113217 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1042/2054] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:23 2022] DELETE /identity/v3/users/c79116777e354734b73a0b334fd013c9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:24.358245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:24.369461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970edb8-2a59-404a-86ff-3e0054f69fc0 service nova] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:24.454030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:24.454750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:24.455404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:24.455841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] PATH_INFO: `/v3/projects/709ccf636093493093e88488ce49484f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:24.457632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709ccf636093493093e88488ce49484f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:24.459952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:24.602575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709ccf636093493093e88488ce49484f', 'request_id': 'req-9700f9fb-dd60-4742-a63d-fa8cf4866170'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.613235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709ccf636093493093e88488ce49484f', 'request_id': 'req-9700f9fb-dd60-4742-a63d-fa8cf4866170'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.621034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709ccf636093493093e88488ce49484f', 'request_id': 'req-9700f9fb-dd60-4742-a63d-fa8cf4866170'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.737263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] The token cache is being invalidate because project 709ccf636093493093e88488ce49484f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:24.737263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.737263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:24.737263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1013/2055] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:24 2022] DELETE /identity/v3/projects/709ccf636093493093e88488ce49484f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:24.740100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:24.741683 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:24.755251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867a41-0f53-41da-99af-01d7e002283b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:24.778691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:24.815968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:24.816624 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:24.816903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:24.817205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] PATH_INFO: `/v3/users/140927ae18a748178917c597bceda7a3` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:24.818312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=140927ae18a748178917c597bceda7a3)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:24.820230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:25.079733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140927ae18a748178917c597bceda7a3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.087804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140927ae18a748178917c597bceda7a3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.101377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140927ae18a748178917c597bceda7a3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.102132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140927ae18a748178917c597bceda7a3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.183304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b8310dea-a75f-49ed-b73a-d931ca6d5bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140927ae18a748178917c597bceda7a3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.190164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1043/2056] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:24 2022] DELETE /identity/v3/users/140927ae18a748178917c597bceda7a3 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:25.426586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:25.428147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:25.447679 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700f9fb-dd60-4742-a63d-fa8cf4866170 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:25.463490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:25.508055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:25.508795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:25.509073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:25.509346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] PATH_INFO: `/v3/projects/498a5c4e87964f8d90611e29a052f911` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:25.510465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=498a5c4e87964f8d90611e29a052f911)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:25.512406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:25.633810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498a5c4e87964f8d90611e29a052f911', 'request_id': 'req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.639511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498a5c4e87964f8d90611e29a052f911', 'request_id': 'req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.648064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498a5c4e87964f8d90611e29a052f911', 'request_id': 'req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.744451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] The token cache is being invalidate because project 498a5c4e87964f8d90611e29a052f911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:25.744745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.745736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:25.747479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1014/2057] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:25 2022] DELETE /identity/v3/projects/498a5c4e87964f8d90611e29a052f911 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:32.876898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:32.882478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:32.882478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:32.901798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:32.903032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:32.963682 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1044/2058] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:13:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:32.980041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:32.982202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:33.057564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3ed2e-720a-4e21-9cb5-f169eae0f07c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:33.062611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:33.063234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:33.063515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:33.063787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:33.072903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:33.074541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:33.082787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1015/2059] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:13:34.314617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:34.314617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:34.402183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:34.424131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ce89f-9e61-4bdf-9900-33b4c555e859 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:34.429698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:34.430343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:34.430641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:34.430924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] PATH_INFO: `/v3/users/7175a36794194edba6b16366b0e12a0c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:34.432755 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7175a36794194edba6b16366b0e12a0c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:34.435188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:34.668194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7175a36794194edba6b16366b0e12a0c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:34.690713 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7175a36794194edba6b16366b0e12a0c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:34.714238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7175a36794194edba6b16366b0e12a0c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:34.715175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7175a36794194edba6b16366b0e12a0c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:34.806148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:34.809459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:34.813749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7175a36794194edba6b16366b0e12a0c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:34.840245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1045/2060] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:34 2022] DELETE /identity/v3/users/7175a36794194edba6b16366b0e12a0c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:34.892937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:34.941543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827a497-2142-4ad4-bda7-530431726604 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:35.057114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:35.057823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:35.058111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:35.058440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:35.061039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:35.079586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:35.079727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2655f3-95ce-4dae-9e46-b6ec59aa2fb4 service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:35.098999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1016/2061] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:35.200928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:35.202974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:35.373438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be7f50-10e6-4edd-9d36-a97d12087766 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:35.382899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:35.384698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:35.385741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:35.386296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] PATH_INFO: `/v3/projects/faf6f8c0f3694f42a30232874a142685` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:35.387790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf6f8c0f3694f42a30232874a142685)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:35.391102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:35.539804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf6f8c0f3694f42a30232874a142685', 'request_id': 'req-5862b624-fbb3-49f5-bd61-a0adc2450cf8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:35.547407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf6f8c0f3694f42a30232874a142685', 'request_id': 'req-5862b624-fbb3-49f5-bd61-a0adc2450cf8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:35.661963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf6f8c0f3694f42a30232874a142685', 'request_id': 'req-5862b624-fbb3-49f5-bd61-a0adc2450cf8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:35.675767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:35.696001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] The token cache is being invalidate because project faf6f8c0f3694f42a30232874a142685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:35.696791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:35.698949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5862b624-fbb3-49f5-bd61-a0adc2450cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:35.702352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1046/2062] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:35 2022] DELETE /identity/v3/projects/faf6f8c0f3694f42a30232874a142685 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:35.707187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:35.707783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:35.708524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:35.781098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:35.782358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:35.876046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1017/2063] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:35.885535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:35.890660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:35.890660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:35.910733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:35.912008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:35.927544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1047/2064] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:35.929441 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:35.943313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4311d-7ae6-4c78-b7a8-dee4a4b8200d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:35.952969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:35.956496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:35.956496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:35.956496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:35.956496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:13:35.956496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:35.957086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:35.973436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1018/2065] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:13:35.975050 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:35.985460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d874d-7e18-4f70-a607-bf65e1ccaeb7 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:35.990370 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:35.991105 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:35.991454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:35.991791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:35.992539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:35.995025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:36.105049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1048/2066] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:35 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:36.108841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:36.120100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca1a01-541a-4638-91c3-fd545d5877aa admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:36.175037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:36.191423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:36.192134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:36.192532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:36.192883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:36.193542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:36.195844 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:36.304072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1019/2067] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:36 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:36.309586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:36.322437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6c59b-5063-4117-857e-61a2c72adeed admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:36.327720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:36.328348 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:36.328667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:36.329086 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:36.329741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:36.331326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:36.342112 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1049/2068] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:13:36.346037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:36.361658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447724-d1be-4398-a882-2883951c3dc1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:36.368756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9757ee-0083-40e3-92fe-b60163e46738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:36.370058 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9757ee-0083-40e3-92fe-b60163e46738 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:36.370370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9757ee-0083-40e3-92fe-b60163e46738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:36.370675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9757ee-0083-40e3-92fe-b60163e46738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:36.371393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9757ee-0083-40e3-92fe-b60163e46738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:36.373043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9757ee-0083-40e3-92fe-b60163e46738 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:36.383998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1020/2069] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:36.388688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:36.398967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95de95-e7e7-45ba-9740-85d886448bf9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:36.403726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:36.404409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:36.404698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:36.404970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] PATH_INFO: `/v3/projects/459af465b6664bf2b571e931c87c52d6/users/9b0f893d26f44c9d99a8c855de0fa16f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:36.423411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459af465b6664bf2b571e931c87c52d6, user_id=9b0f893d26f44c9d99a8c855de0fa16f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:36.426203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:36.643924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1050/2070] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:36 2022] PUT /identity/v3/projects/459af465b6664bf2b571e931c87c52d6/users/9b0f893d26f44c9d99a8c855de0fa16f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:36.646073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9e971-aeb4-493c-ae9a-4ee109173e2e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:36.646359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9e971-aeb4-493c-ae9a-4ee109173e2e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:36.646629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9e971-aeb4-493c-ae9a-4ee109173e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:36.676160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fca9e971-aeb4-493c-ae9a-4ee109173e2e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:36.677517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fca9e971-aeb4-493c-ae9a-4ee109173e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:36.758043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1021/2071] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:36.767931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:36.769884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:36.850394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c8ced-effc-43ec-a7b6-d685c6412026 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:36.855251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:36.855955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:36.856299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:36.856679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:36.868250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:36.870623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:36.881881 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1051/2072] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:46.265539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:46.266180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:46.266180 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:46.295653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] MFA Rules not processed for user `9b0f893d26f44c9d99a8c855de0fa16f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:46.296954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:46.362978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1022/2073] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:46.367982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:46.378543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45694e-d0a8-464e-930c-a8de39438677 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:46.383307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:46.383907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:46.384219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:46.384519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:46.385186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:46.388037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:46.648903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1052/2074] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:46 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:46.649298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:46.669607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe04c8-fcec-41d3-b013-142d5894dfdd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:46.737623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:46.746117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:46.747502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:46.747502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:46.747502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:46.748080 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:46.750036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:46.870554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1023/2075] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:46 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:13:46.872897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:46.885865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfde6a9-3175-43e4-8c75-8280d9946fef admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:46.907706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:46.908483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:46.908833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:46.909118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:46.910047 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:46.911708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:46.946342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1053/2076] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:46.950727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:46.968992 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e46ede-8b7d-456c-b6fa-c4bd50e3ecd3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:46.978572 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:46.979262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:46.979541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:46.979812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] PATH_INFO: `/v3/projects/69a91f013252401abf865ffcaea1858c/users/e5df645c8b674096a8a9b19d736ce5da/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:47.026361 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a91f013252401abf865ffcaea1858c, user_id=e5df645c8b674096a8a9b19d736ce5da, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:47.032500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:47.173367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1024/2077] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:46 2022] PUT /identity/v3/projects/69a91f013252401abf865ffcaea1858c/users/e5df645c8b674096a8a9b19d736ce5da/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:47.176966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:47.193725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1893d-fd92-4695-a882-09515853242c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:47.340993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:47.341622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:47.342085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:47.342085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:47.342813 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:47.344571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:47.350493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:47.370107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1054/2078] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:47.373952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:47.386493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17259a25-7d98-40bb-80fc-127ac75d291d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:47.392971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eee23-1915-417a-9dbb-f5035299b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:47.393638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eee23-1915-417a-9dbb-f5035299b272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:47.394088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eee23-1915-417a-9dbb-f5035299b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:47.394376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eee23-1915-417a-9dbb-f5035299b272 admin admin] PATH_INFO: `/v3/projects/69a91f013252401abf865ffcaea1858c/users/e5df645c8b674096a8a9b19d736ce5da/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:47.396583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eee23-1915-417a-9dbb-f5035299b272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a91f013252401abf865ffcaea1858c, user_id=e5df645c8b674096a8a9b19d736ce5da, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:47.399366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eee23-1915-417a-9dbb-f5035299b272 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:47.415946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1025/2079] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:47 2022] PUT /identity/v3/projects/69a91f013252401abf865ffcaea1858c/users/e5df645c8b674096a8a9b19d736ce5da/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:13:50.050993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:50.050993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:50.142487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf82497-45f1-4840-bae6-cac0c576adc9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:50.250411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:50.251717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:50.252085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:50.252461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:50.255448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:50.372836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:50.374822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:50.386149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1055/2080] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:55.023242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:55.023757 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:55.024074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:55.054044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] MFA Rules not processed for user `e5df645c8b674096a8a9b19d736ce5da`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:55.055337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:55.182178 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1026/2081] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:55.217655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:55.220055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:55.337637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:55.364144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3717c8-ccae-4f09-a5e6-6544a272afeb service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:55.377462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:55.378263 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:55.379646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:55.379646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:55.500861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:55.500861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:55.510905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1056/2082] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:55.567641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:55.578250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bf536-fe7d-4649-b13a-6cd5517c57d9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:55.582747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:55.584241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:55.584719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:55.586137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:55.587631 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:55.602029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:55.604063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:55.614665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1027/2083] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:13:55.880380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:55.882093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:55.902569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb824b-c23b-41d7-bbb5-eee4da334fc3 service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:55.915008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:55.915716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:55.916188 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:55.916518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] PATH_INFO: `/v3/users/2c196d842c4540b5800b4efa0ec4fc73` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:55.918339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c196d842c4540b5800b4efa0ec4fc73)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:55.921549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:56.242882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c196d842c4540b5800b4efa0ec4fc73'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:56.255965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c196d842c4540b5800b4efa0ec4fc73'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:56.281709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c196d842c4540b5800b4efa0ec4fc73'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:56.282731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c196d842c4540b5800b4efa0ec4fc73'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:56.368187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c196d842c4540b5800b4efa0ec4fc73'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:56.376218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1057/2084] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:55 2022] DELETE /identity/v3/users/2c196d842c4540b5800b4efa0ec4fc73 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:56.728231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:56.747474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c1be-779d-42f0-bb7e-6c56fa4f0170 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:56.757400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:56.759474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:56.866779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752dc53-534b-452c-acde-42664b594572 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:56.869508 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:56.870235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:56.870539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:56.870918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] PATH_INFO: `/v3/projects/ab840c288db6497bbd3a4b221cddf009` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:56.878997 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab840c288db6497bbd3a4b221cddf009)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:56.879166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:56.879166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:56.879166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:56.879166 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:56.879483 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:56.879564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:56.899729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:56.901933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0ba8-4ad6-48ec-9b7a-ca1c64b8f3c9 service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:56.915612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1058/2085] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:13:56.915850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:57.033236 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab840c288db6497bbd3a4b221cddf009', 'request_id': 'req-f7d674f9-4776-43b3-8e86-c1b330d2d566'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:57.042578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab840c288db6497bbd3a4b221cddf009', 'request_id': 'req-f7d674f9-4776-43b3-8e86-c1b330d2d566'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:57.053050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab840c288db6497bbd3a4b221cddf009', 'request_id': 'req-f7d674f9-4776-43b3-8e86-c1b330d2d566'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:57.124553 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] The token cache is being invalidate because project ab840c288db6497bbd3a4b221cddf009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:13:57.125378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:57.126535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f7d674f9-4776-43b3-8e86-c1b330d2d566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:57.131207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1028/2086] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:56 2022] DELETE /identity/v3/projects/ab840c288db6497bbd3a4b221cddf009 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:57.133199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.133494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.133772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.143157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:57.157748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:57.159053 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:57.227629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1059/2087] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:57.236009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.236301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.236706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.264086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:57.266092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:57.274345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1029/2088] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:57.278843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.289494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e37e9-8d94-4ddd-b46b-2f2dcb755aab None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:57.294403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:57.295398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.296270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.296793 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.298018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:13:57.298171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:57.299991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:57.313139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1060/2089] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:13:57.318784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.331247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41245fe6-229d-4446-8caa-eaebc951b3cc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:57.336826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:57.337731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.338312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.338759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.339579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:57.342028 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:57.448841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1030/2090] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:13:57 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:57.450048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.460599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6a6b1-d249-4c92-953b-a48bdde1c0af admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:57.522530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:57.523131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.523410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.523952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.524818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:57.527457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:57.621934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1061/2091] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:13:57 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:13:57.622436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.634842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcbfff-b6a8-4df8-8943-c2621ba5226a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:57.642179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:57.642797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.643110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.643379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.644021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:57.645690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:57.660239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1031/2092] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:57.661505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.671581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7da15-cf17-4170-8cf8-5e1031f3c450 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:57.676343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ecea2-9d0b-4071-9643-d4238d773081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:57.677035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecea2-9d0b-4071-9643-d4238d773081 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.677293 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecea2-9d0b-4071-9643-d4238d773081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.677569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ecea2-9d0b-4071-9643-d4238d773081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.678219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ecea2-9d0b-4071-9643-d4238d773081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:57.679811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ecea2-9d0b-4071-9643-d4238d773081 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:57.692106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1062/2093] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:13:57.696303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.706943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac96b0-0f81-4b59-a063-a9bcaa33c233 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:57.711587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:57.712239 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.712569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.712850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] PATH_INFO: `/v3/projects/a537324689d2495da97034bd54e55586/users/acedaf10a17f41c583cbfe54181cb5d8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.736725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a537324689d2495da97034bd54e55586, user_id=acedaf10a17f41c583cbfe54181cb5d8, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:57.739454 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:57.816822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1032/2094] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:13:57 2022] PUT /identity/v3/projects/a537324689d2495da97034bd54e55586/users/acedaf10a17f41c583cbfe54181cb5d8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:57.828987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:57.832968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:57.832968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:57.859561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] MFA Rules not processed for user `acedaf10a17f41c583cbfe54181cb5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:57.860952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:57.930107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:57.935867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1063/2095] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:57.946988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:57.949411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:58.032900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200c82-49d3-4b43-8e01-6b2becaf3dd6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:58.038600 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad1f2b-3ea7-43ad-a753-96acba9f1ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:58.039201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad1f2b-3ea7-43ad-a753-96acba9f1ebe service nova] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:58.039470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad1f2b-3ea7-43ad-a753-96acba9f1ebe service nova] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:58.039744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad1f2b-3ea7-43ad-a753-96acba9f1ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:58.049016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad1f2b-3ea7-43ad-a753-96acba9f1ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:58.050647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad1f2b-3ea7-43ad-a753-96acba9f1ebe service nova] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:58.060122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1033/2096] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:13:58.292258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:58.294318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:58.363754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c333c-57a2-4e2f-af4f-7d7f0102836c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:58.368378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:58.369031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:58.369310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:58.369583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] PATH_INFO: `/v3/users/05c47ba246d74df6ba1998162a93f251` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:58.370709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c47ba246d74df6ba1998162a93f251)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:58.372842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:58.553052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c47ba246d74df6ba1998162a93f251'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:58.563823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c47ba246d74df6ba1998162a93f251'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:58.579854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c47ba246d74df6ba1998162a93f251'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:58.580738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c47ba246d74df6ba1998162a93f251'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:58.659975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c47ba246d74df6ba1998162a93f251'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:13:58.680428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1064/2097] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:13:58 2022] DELETE /identity/v3/users/05c47ba246d74df6ba1998162a93f251 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:13:58.681885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8a069-53f1-41a9-b3f4-22129a67b511 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:58.682254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8a069-53f1-41a9-b3f4-22129a67b511 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:58.683131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8a069-53f1-41a9-b3f4-22129a67b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:58.714190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-88e8a069-53f1-41a9-b3f4-22129a67b511 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:58.715602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-88e8a069-53f1-41a9-b3f4-22129a67b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:58.745334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:58.817408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1034/2098] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:13:58.817574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:58.818888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:58.973896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1feea6-255a-42bd-93f1-35c5c9aafbcd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:58.979636 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:58.980471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:58.980757 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:58.981045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:59.002643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:59.003250 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:59.003731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:59.018723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:59.020346 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:13:59.029199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] MFA Rules not processed for user `9b0f893d26f44c9d99a8c855de0fa16f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:13:59.031356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:59.045048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1065/2099] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:13:59.100307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1035/2100] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:13:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:13:59.784427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:13:59.784427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:13:59.818002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:13:59.890591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece926d7-7f44-412f-a51d-6d3fb26def4c service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:13:59.910020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:13:59.910866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:13:59.911255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:13:59.911635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] PATH_INFO: `/v3/projects/c30e57903d5a4b188d421a3668840ba2` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:13:59.915674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30e57903d5a4b188d421a3668840ba2)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:13:59.917786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:00.055167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30e57903d5a4b188d421a3668840ba2', 'request_id': 'req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.060189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30e57903d5a4b188d421a3668840ba2', 'request_id': 'req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.151821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30e57903d5a4b188d421a3668840ba2', 'request_id': 'req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.173535 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] The token cache is being invalidate because project c30e57903d5a4b188d421a3668840ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:00.174071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.175842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.179307 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1066/2101] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:13:59 2022] DELETE /identity/v3/projects/c30e57903d5a4b188d421a3668840ba2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:00.183461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:00.282099 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b717a-4519-45c8-942c-0bbe3bd8f741 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:00.385681 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:00.388677 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:00.389092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:00.389447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] PATH_INFO: `/v3/users/ada8c8d588a443e2b8556e06fd797514` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:00.392764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada8c8d588a443e2b8556e06fd797514)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:00.398643 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:00.701191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada8c8d588a443e2b8556e06fd797514'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.709943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada8c8d588a443e2b8556e06fd797514'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.710759 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada8c8d588a443e2b8556e06fd797514'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.714717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:00.775203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada8c8d588a443e2b8556e06fd797514'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.792112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada8c8d588a443e2b8556e06fd797514'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:00.800767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1036/2102] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:00 2022] DELETE /identity/v3/users/ada8c8d588a443e2b8556e06fd797514 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:01.559469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:01.561391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:01.577242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c8bc-6adb-4ffb-9cfe-e85d0dfcba06 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:01.667790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:01.668547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:01.668830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:01.669322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] PATH_INFO: `/v3/projects/922347ce66bf422eaa8c883075068836` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:01.679633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=922347ce66bf422eaa8c883075068836)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:01.684083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:01.732814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:01.735128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:01.749617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b9b5-de77-4564-a382-bffe8c893d3e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:01.773518 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:01.774221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:01.774505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:01.774782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] PATH_INFO: `/v3/users/acedaf10a17f41c583cbfe54181cb5d8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:01.775940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acedaf10a17f41c583cbfe54181cb5d8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:01.778081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:01.805232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:01.812164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922347ce66bf422eaa8c883075068836', 'request_id': 'req-47d5af4d-89e3-411d-8a38-24eb690ba6be'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:01.825893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922347ce66bf422eaa8c883075068836', 'request_id': 'req-47d5af4d-89e3-411d-8a38-24eb690ba6be'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:01.914219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922347ce66bf422eaa8c883075068836', 'request_id': 'req-47d5af4d-89e3-411d-8a38-24eb690ba6be'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:01.925676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] The token cache is being invalidate because project 922347ce66bf422eaa8c883075068836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:01.925969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:01.933144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-47d5af4d-89e3-411d-8a38-24eb690ba6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:01.933144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1067/2103] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:01 2022] DELETE /identity/v3/projects/922347ce66bf422eaa8c883075068836 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:01.933144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b92ff-6953-4777-9a93-fd6890995356 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:01.933144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b92ff-6953-4777-9a93-fd6890995356 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:01.933997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b92ff-6953-4777-9a93-fd6890995356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.001161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acedaf10a17f41c583cbfe54181cb5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:02.014450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acedaf10a17f41c583cbfe54181cb5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:02.015268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acedaf10a17f41c583cbfe54181cb5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:02.015894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6d9b92ff-6953-4777-9a93-fd6890995356 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:02.017530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6d9b92ff-6953-4777-9a93-fd6890995356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:02.089179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acedaf10a17f41c583cbfe54181cb5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:02.090525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1068/2104] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:02.091792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.092241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.092935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.115770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f3a6021a-6b74-4049-9f4c-fbd5f65d7421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acedaf10a17f41c583cbfe54181cb5d8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:02.130233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1037/2105] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:01 2022] DELETE /identity/v3/users/acedaf10a17f41c583cbfe54181cb5d8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:02.131768 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92c23b-8841-4e9a-a482-dc05ec9296b7 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.132061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92c23b-8841-4e9a-a482-dc05ec9296b7 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.132335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92c23b-8841-4e9a-a482-dc05ec9296b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.143133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:02.144357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:02.156956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-4d92c23b-8841-4e9a-a482-dc05ec9296b7 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:02.157328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4d92c23b-8841-4e9a-a482-dc05ec9296b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:02.227743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1038/2106] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:02.229125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.229420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.229687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.233647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1069/2107] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:02.234783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.248729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d388cd-99dd-4799-8b45-a47a1b416800 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.268916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:02.270147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.271925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:02.272063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.272063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.272063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.272412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:02.272412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.275227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:02.281627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1039/2108] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:02.282747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.284605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:02.306528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1070/2109] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:02.306528 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.313084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:02.361719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:02.390009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f873874-a9fd-41d4-9bbd-baf79dddd37e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.397738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.398165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.398455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.398839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.411052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.413258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:02.432812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1040/2110] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:02.433900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.447363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd2e72-9103-477b-9803-1806038b0b0d service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.452323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.457223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.457223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.457223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.457223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.457223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:02.458805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0858-43f0-4537-a55d-2cdb437f0025 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.463025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.463724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.465057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.465407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.482116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.482116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:02.505997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1071/2111] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:02.571734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1041/2112] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:02 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:02.572978 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.587710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88698d04-ef57-47c4-b430-bfb65c28041d service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.723772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.724686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.724969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.725245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.725901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.728644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:02.753163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:02.846518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1072/2113] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:02 2022] POST /identity/v3/users => generated 300 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:02.849228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.865440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094b40-1b1c-4ab0-9a8f-1ece04f9da6d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.898521 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.902051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.903093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.904717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.909009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.917823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:02.949549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1042/2114] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:02.950534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:02.972602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ab6f-0c09-4f54-8fac-4c4be6377f14 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:02.981456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae10a9-1fbb-45c1-8166-bb9de1e9fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:02.982675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae10a9-1fbb-45c1-8166-bb9de1e9fbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:02.983040 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae10a9-1fbb-45c1-8166-bb9de1e9fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:02.983772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae10a9-1fbb-45c1-8166-bb9de1e9fbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:02.985615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae10a9-1fbb-45c1-8166-bb9de1e9fbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:02.988027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae10a9-1fbb-45c1-8166-bb9de1e9fbb2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.015968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1073/2115] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:03.017328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.028986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ddcf7-e8c1-40f3-8424-f468ff9e5acd admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.036147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.037461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.038121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.038623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] PATH_INFO: `/v3/projects/d0643c73ade84497918273ce85fb8341/users/ca9ae3ab605941d99d661d5c691dea7f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.057067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0643c73ade84497918273ce85fb8341, user_id=ca9ae3ab605941d99d661d5c691dea7f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.060650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.130388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1043/2116] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:03 2022] PUT /identity/v3/projects/d0643c73ade84497918273ce85fb8341/users/ca9ae3ab605941d99d661d5c691dea7f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:03.155113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.155721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.156773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.218131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] MFA Rules not processed for user `ca9ae3ab605941d99d661d5c691dea7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:03.219828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:03.283822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.286430 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:03.323903 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:03.346455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1074/2117] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:03.347775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.425967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe3366-04ac-4aa9-babd-d40fcc90c5f6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.431158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.432205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.432499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.432818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] PATH_INFO: `/v3/projects/a537324689d2495da97034bd54e55586` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.434081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a537324689d2495da97034bd54e55586)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.435897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.489340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1f2de-b212-42e6-a36d-3b0cdb362aa6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.494335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.494994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.495340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.495652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.496317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.498406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.551965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a537324689d2495da97034bd54e55586', 'request_id': 'req-495e3876-c7c1-479f-b167-791e7dca7ab9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:03.563455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a537324689d2495da97034bd54e55586', 'request_id': 'req-495e3876-c7c1-479f-b167-791e7dca7ab9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:03.571657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a537324689d2495da97034bd54e55586', 'request_id': 'req-495e3876-c7c1-479f-b167-791e7dca7ab9'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:03.629691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1075/2118] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:03 2022] POST /identity/v3/projects => generated 399 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:03.634135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.646771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:03.653370 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] The token cache is being invalidate because project a537324689d2495da97034bd54e55586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:03.653970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:03.655043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-495e3876-c7c1-479f-b167-791e7dca7ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:03.669313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1044/2119] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:03 2022] DELETE /identity/v3/projects/a537324689d2495da97034bd54e55586 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:03.674093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9ef4d-06ae-4a72-b782-a87b0c0486c6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.674584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9ef4d-06ae-4a72-b782-a87b0c0486c6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.674995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9ef4d-06ae-4a72-b782-a87b0c0486c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.710392 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-96d9ef4d-06ae-4a72-b782-a87b0c0486c6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:03.711722 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-96d9ef4d-06ae-4a72-b782-a87b0c0486c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:03.794136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807c3dc-7eb8-41e8-976c-11bd71c3d857 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.804549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.805180 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.805460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.805733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.806311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1045/2120] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:03.813231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.815236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.815972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.816490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.817187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.851055 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:03.852398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:03.864785 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1046/2121] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:03.869234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.880160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24554e37-3231-44b6-86ba-c519bc6e6e2b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.884989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.885593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.885942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.886302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.886961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:03.887272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.888914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.909822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1047/2122] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:03.910935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.913465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1076/2123] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:03 2022] POST /identity/v3/users => generated 306 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:03.917714 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:03.921884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:03.937628 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2855e-0057-46c2-a387-95df6e4421e7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.944778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.945467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.945902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.946255 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.947078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.949547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:03.953037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e3dc6-31f0-4493-8c5b-74b6377e6121 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:03.965428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:03.973505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:03.973505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:03.973505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:03.973505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:03.973505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.004516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1077/2124] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:04.006408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.029299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b2bd3-d014-4219-bad4-070079c60970 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.035007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.035751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.036039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.036323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] PATH_INFO: `/v3/projects/cdcce88f934a4f3b834d059718ae2d79/users/dcc1ae51b52048c7979420b97a787da4/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.059776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1048/2125] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:03 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:04.074601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.080381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcce88f934a4f3b834d059718ae2d79, user_id=dcc1ae51b52048c7979420b97a787da4, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.084657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.166265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1078/2126] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:04 2022] PUT /identity/v3/projects/cdcce88f934a4f3b834d059718ae2d79/users/dcc1ae51b52048c7979420b97a787da4/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:04.168224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.265462 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1a8d8-cfe4-4b62-ae63-4dd4263267c7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.305413 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:04.368052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7f322-6707-48f3-8a87-5a77e2502ac3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.399193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.399819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.400156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.400508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.401107 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.402661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.437331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1079/2127] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:04.440849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.480660 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8591d3-2c9b-43f0-af36-20ee259ed20f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.483158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.483786 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.484070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.484345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.485582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.487653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.492059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022469-c5eb-477c-bfc9-04b740e6894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.494854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022469-c5eb-477c-bfc9-04b740e6894e admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.495156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022469-c5eb-477c-bfc9-04b740e6894e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.495440 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022469-c5eb-477c-bfc9-04b740e6894e admin admin] PATH_INFO: `/v3/projects/cdcce88f934a4f3b834d059718ae2d79/users/dcc1ae51b52048c7979420b97a787da4/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.498660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:04.501862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93022469-c5eb-477c-bfc9-04b740e6894e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcce88f934a4f3b834d059718ae2d79, user_id=dcc1ae51b52048c7979420b97a787da4, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.504603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93022469-c5eb-477c-bfc9-04b740e6894e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.528957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1080/2128] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:04 2022] PUT /identity/v3/projects/cdcce88f934a4f3b834d059718ae2d79/users/dcc1ae51b52048c7979420b97a787da4/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:04.536953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.537630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.537630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.586351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] MFA Rules not processed for user `dcc1ae51b52048c7979420b97a787da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:04.589097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:04.596433 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1049/2129] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:04 2022] POST /identity/v3/users => generated 290 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:04.605257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.618892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32732cc-1085-453e-8a6a-6e677c9535e4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.722707 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1081/2130] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:04.733364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.735421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:04.737088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.737875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.738347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.738688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.739502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.741583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.783564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1050/2131] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:04.788065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.799727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31d2a-d71f-488f-a68c-867dd917498c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.804692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.805633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.805633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.806087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.806746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.808705 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.829653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1051/2132] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:04.831573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:04.849144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355016b9-9d66-4e85-8bd0-427543660429 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.856355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.857027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.857245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.857522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] PATH_INFO: `/v3/projects/42343a7db9264f9eaf48876d81111975/users/c31d3b1384154ee9a70afcd3b7f1326d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.873704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be286ce-be90-4ee0-8ebe-ff2f02dd8794 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:04.878568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbb168-7622-4c61-8c99-f178a7dc86fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:04.878897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42343a7db9264f9eaf48876d81111975, user_id=c31d3b1384154ee9a70afcd3b7f1326d, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.879491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb168-7622-4c61-8c99-f178a7dc86fd service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.879869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb168-7622-4c61-8c99-f178a7dc86fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.880247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb168-7622-4c61-8c99-f178a7dc86fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:04.883521 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.893503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb168-7622-4c61-8c99-f178a7dc86fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:04.895269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbb168-7622-4c61-8c99-f178a7dc86fd service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:04.908257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1082/2133] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:04 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:04.958812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1052/2134] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:04 2022] PUT /identity/v3/projects/42343a7db9264f9eaf48876d81111975/users/c31d3b1384154ee9a70afcd3b7f1326d/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:04.971129 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:04.971570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:04.971995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:05.010816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] MFA Rules not processed for user `c31d3b1384154ee9a70afcd3b7f1326d`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:05.012453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:05.046389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:05.107501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1083/2135] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:05.112301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:05.151709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:05.215885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4138d0f-07f2-4a38-bae7-5409cb033916 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:05.221538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:05.222619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:05.222963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:05.223300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:05.224240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:05.227774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:05.271604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e250e1-5542-4ae9-9abf-be2af57059a6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:05.275661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:05.276461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:05.276965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:05.277365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:05.279709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:05.322354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1053/2136] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:05 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:05.323026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:05.374525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:05.376614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:05.388999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:05.389667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1084/2137] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:05.412633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7446-3c3d-4581-9010-c83c52bab58e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:05.419046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:05.419790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:05.420006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:05.420288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:05.421107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:05.423137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:05.545486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1054/2138] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:05 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:05.550365 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:05.571864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4311f9-9c93-4e6a-9f95-bcc903ea134b service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:05.585691 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:05.587355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:05.587618 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:05.591791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:05.594729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:05.598908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:05.641723 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1085/2139] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:05.643278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:05.664323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c97218-ab47-491e-a3c7-f906b7f8db48 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:05.684660 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:05.685357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:05.686272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:05.686952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] PATH_INFO: `/v3/projects/ab3f2e17716a4a098e4cb29871f0af55/users/9d1754fbbfcb4110968eca545bb92d6a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:05.736455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f2e17716a4a098e4cb29871f0af55, user_id=9d1754fbbfcb4110968eca545bb92d6a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:05.747737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:05.955670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1055/2140] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:05 2022] PUT /identity/v3/projects/ab3f2e17716a4a098e4cb29871f0af55/users/9d1754fbbfcb4110968eca545bb92d6a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:05.960073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:05.974342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21644e-e6ab-465e-88d8-af2741e32fe0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:06.056053 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025acde-0176-4703-89eb-7958a77c2284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:06.056798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025acde-0176-4703-89eb-7958a77c2284 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:06.057191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025acde-0176-4703-89eb-7958a77c2284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:06.057543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025acde-0176-4703-89eb-7958a77c2284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:06.058311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025acde-0176-4703-89eb-7958a77c2284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:06.060580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025acde-0176-4703-89eb-7958a77c2284 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:06.067921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:06.076326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1086/2141] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:06.077532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:06.091808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6ee2e-9f1f-4a81-b4fc-c778c565f556 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:06.099188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:06.099188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:06.099188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:06.099188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] PATH_INFO: `/v3/projects/ab3f2e17716a4a098e4cb29871f0af55/users/9d1754fbbfcb4110968eca545bb92d6a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:06.101520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f2e17716a4a098e4cb29871f0af55, user_id=9d1754fbbfcb4110968eca545bb92d6a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:06.104417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:06.117209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1056/2142] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:06 2022] PUT /identity/v3/projects/ab3f2e17716a4a098e4cb29871f0af55/users/9d1754fbbfcb4110968eca545bb92d6a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:06.132465 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:06.132832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:06.133117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:06.181420 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] MFA Rules not processed for user `9d1754fbbfcb4110968eca545bb92d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:06.182948 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:06.282596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1087/2143] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:06.295852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:06.298775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:06.461442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e321ca-fe8d-4f86-935d-73a07008b8ce admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:06.486182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:06.486840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:06.487125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:06.487401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:06.512337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:06.513926 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:06.532419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1057/2144] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:07.722065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:07.733226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7489c-a607-4872-b46a-d99cb854ec63 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:07.738501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d1754fbbfcb4110968eca545bb92d6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3f2e17716a4a098e4cb29871f0af55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:07.739109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:07.739393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:07.739669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:07.740311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:07.740811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:07.742377 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:07.762932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1088/2145] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:14:07.766497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:07.776829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc79a5-2bac-4c2a-a95f-021497917710 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:07.781955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d1754fbbfcb4110968eca545bb92d6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3f2e17716a4a098e4cb29871f0af55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:07.783190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:07.783468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:07.783741 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:07.784376 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:07.786337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:07.901066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1058/2146] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:07 2022] POST /identity/v3/projects => generated 354 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:07.905836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:07.918663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d5fe2-12cc-48a0-8ac9-88a5bd0f80ed tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:08.060405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d1754fbbfcb4110968eca545bb92d6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3f2e17716a4a098e4cb29871f0af55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:08.061157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:08.062271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:08.063075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:08.065396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:08.065938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:08.071335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:08.111251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1089/2147] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:14:08.182742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:08.196120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f835-76f8-4921-a7bc-3a6e0260bbea tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:08.203579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d1754fbbfcb4110968eca545bb92d6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3f2e17716a4a098e4cb29871f0af55', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:08.204303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:08.205248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:08.205545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] PATH_INFO: `/v3/projects/e9392505c7584b48802a00336541579b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:08.207514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9392505c7584b48802a00336541579b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:08.210451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:08.415129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9392505c7584b48802a00336541579b', 'request_id': 'req-e93c3737-0f30-4429-b491-f2189e2dc70f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:08.427383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9392505c7584b48802a00336541579b', 'request_id': 'req-e93c3737-0f30-4429-b491-f2189e2dc70f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:08.438516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9392505c7584b48802a00336541579b', 'request_id': 'req-e93c3737-0f30-4429-b491-f2189e2dc70f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:08.445890 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:08.550288 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] The token cache is being invalidate because project e9392505c7584b48802a00336541579b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:08.551313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:08.552131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:08.554307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1059/2148] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:08 2022] DELETE /identity/v3/projects/e9392505c7584b48802a00336541579b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:09.242807 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:09.244712 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:09.335922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03b45-23b5-4ddc-ba8c-7bec1859f655 tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:09.369406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:09.445633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:09.445900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:09.446288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:09.446628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] PATH_INFO: `/v3/users/c31d3b1384154ee9a70afcd3b7f1326d` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:09.452108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31d3b1384154ee9a70afcd3b7f1326d)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:09.454197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:09.630560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:09.632246 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:09.693846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31d3b1384154ee9a70afcd3b7f1326d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:09.704566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31d3b1384154ee9a70afcd3b7f1326d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:09.724341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31d3b1384154ee9a70afcd3b7f1326d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:09.725205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31d3b1384154ee9a70afcd3b7f1326d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:09.757998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c3737-0f30-4429-b491-f2189e2dc70f tempest-VolumeQuotaClassesTest-438011105 tempest-VolumeQuotaClassesTest-438011105-project-admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:09.765468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:09.766261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:09.766709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:09.768998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:09.771830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:09.786914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:09.788485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:09.799422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-71e3c032-3c58-4a43-9533-94f91736e9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31d3b1384154ee9a70afcd3b7f1326d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:09.808189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1090/2149] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:09 2022] DELETE /identity/v3/users/c31d3b1384154ee9a70afcd3b7f1326d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:09.828608 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:09.828951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:09.830519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:09.836273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1060/2150] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:09.870275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:09.871661 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:09.955360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1091/2151] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:09.978772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:09.978772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:10.013229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70bcc-6055-48b4-b704-79d5bb69b1da service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:10.074809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:10.075436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:10.075715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:10.076106 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:10.086756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:10.096828 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:10.099011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1061/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:10.932257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:10.938421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:10.955517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec531-6176-4796-9a7e-5bfd33914788 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:10.976638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:10.977471 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:10.977859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:10.978319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] PATH_INFO: `/v3/projects/42343a7db9264f9eaf48876d81111975` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:10.981156 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42343a7db9264f9eaf48876d81111975)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:10.983219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:11.140007 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:11.156505 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42343a7db9264f9eaf48876d81111975', 'request_id': 'req-d3d21c46-8c28-41d9-9071-1d1439ced32c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:11.162058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42343a7db9264f9eaf48876d81111975', 'request_id': 'req-d3d21c46-8c28-41d9-9071-1d1439ced32c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:11.723146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42343a7db9264f9eaf48876d81111975', 'request_id': 'req-d3d21c46-8c28-41d9-9071-1d1439ced32c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:11.746100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] The token cache is being invalidate because project 42343a7db9264f9eaf48876d81111975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:11.746100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:11.746100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:11.746100 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1092/2153] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:10 2022] DELETE /identity/v3/projects/42343a7db9264f9eaf48876d81111975 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:11.747223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:11.756313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bcfec3-7d16-4b83-a5d9-ad06661a0f21 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:11.845067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:11.845555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:11.846522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:11.847014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] PATH_INFO: `/v3/users/9d1754fbbfcb4110968eca545bb92d6a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:11.848303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1754fbbfcb4110968eca545bb92d6a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:11.850311 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:12.271454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:12.273038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:12.287742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d21c46-8c28-41d9-9071-1d1439ced32c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:12.292654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:12.297039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:12.297039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:12.297039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] PATH_INFO: `/v3/users/ca9ae3ab605941d99d661d5c691dea7f` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:12.297039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9ae3ab605941d99d661d5c691dea7f)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:12.297039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:12.451147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:12.453037 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1754fbbfcb4110968eca545bb92d6a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.462959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1754fbbfcb4110968eca545bb92d6a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.467735 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1754fbbfcb4110968eca545bb92d6a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.565338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9ae3ab605941d99d661d5c691dea7f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.573449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9ae3ab605941d99d661d5c691dea7f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.585771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9ae3ab605941d99d661d5c691dea7f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.586567 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9ae3ab605941d99d661d5c691dea7f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.612045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1754fbbfcb4110968eca545bb92d6a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.625265 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-4c036b86-1643-49a8-bb03-7fa0cd936508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1754fbbfcb4110968eca545bb92d6a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.633128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1062/2154] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:11 2022] DELETE /identity/v3/users/9d1754fbbfcb4110968eca545bb92d6a => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:12.680179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9ae3ab605941d99d661d5c691dea7f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:12.688769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1093/2155] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:12 2022] DELETE /identity/v3/users/ca9ae3ab605941d99d661d5c691dea7f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:12.695065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:12.695065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:12.695065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:12.718549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:12.720044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:12.784619 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1063/2156] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:12.795664 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:12.799586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:12.895527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52138953-1183-4d46-b18d-c70aaeaeb9ee admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:12.901582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:12.902376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:12.902762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:12.903138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:12.923216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:12.925271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:12.936957 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1094/2157] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:14:13.137793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:13.137793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:13.165936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abc955-3a17-4c7c-b04d-5e4572443d51 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:13.176411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:13.177075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.177405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.177682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] PATH_INFO: `/v3/projects/ab3f2e17716a4a098e4cb29871f0af55` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.180160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3f2e17716a4a098e4cb29871f0af55)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:13.182764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:13.363478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3f2e17716a4a098e4cb29871f0af55', 'request_id': 'req-c7219cac-16cd-4a80-a358-d3a4c262f645'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.371184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3f2e17716a4a098e4cb29871f0af55', 'request_id': 'req-c7219cac-16cd-4a80-a358-d3a4c262f645'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.387629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3f2e17716a4a098e4cb29871f0af55', 'request_id': 'req-c7219cac-16cd-4a80-a358-d3a4c262f645'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.409952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:13.412197 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:13.424521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec173cb6-b19a-4a97-94b0-016ce2816849 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:13.442520 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] The token cache is being invalidate because project ab3f2e17716a4a098e4cb29871f0af55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:13.442747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.444011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-c7219cac-16cd-4a80-a358-d3a4c262f645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.446434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1064/2158] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:13 2022] DELETE /identity/v3/projects/ab3f2e17716a4a098e4cb29871f0af55 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:13.451033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad252-fe2d-478e-b2f8-ee494db92167 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.451973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad252-fe2d-478e-b2f8-ee494db92167 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.453112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ad252-fe2d-478e-b2f8-ee494db92167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.460570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:13.478523 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9e9ad252-fe2d-478e-b2f8-ee494db92167 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:13.479728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9e9ad252-fe2d-478e-b2f8-ee494db92167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:13.494705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:13.495340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.495731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.497779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] PATH_INFO: `/v3/projects/d0643c73ade84497918273ce85fb8341` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.497779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0643c73ade84497918273ce85fb8341)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:13.499088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:13.548852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1065/2159] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:13.558266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.558647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.558970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.585662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:13.586963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:13.599774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1066/2160] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:13.600920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:13.615271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65782ace-49fd-4ec3-b9c7-c5fedd01206a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:13.622663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:13.627919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.627919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.627919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.627919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:13.627919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:13.628327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:13.647175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1067/2161] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:13.649560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:13.653276 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:13.657534 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0643c73ade84497918273ce85fb8341', 'request_id': 'req-1d25bb59-fe33-4404-9b3b-377271986550'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.672529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0643c73ade84497918273ce85fb8341', 'request_id': 'req-1d25bb59-fe33-4404-9b3b-377271986550'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.696945 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719ce65-52f9-4a87-8466-e62d715cdf07 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:13.776332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:13.776976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.777257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.777536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.777998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0643c73ade84497918273ce85fb8341', 'request_id': 'req-1d25bb59-fe33-4404-9b3b-377271986550'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.778314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:13.780379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:13.808456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] The token cache is being invalidate because project d0643c73ade84497918273ce85fb8341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:13.808766 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.809426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:13.811229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1095/2162] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:13 2022] DELETE /identity/v3/projects/d0643c73ade84497918273ce85fb8341 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:13.815688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:13.817389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:13.835080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25bb59-fe33-4404-9b3b-377271986550 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:13.843852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:13.844605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:13.844953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:13.845317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] PATH_INFO: `/v3/users/dcc1ae51b52048c7979420b97a787da4` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:13.846652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc1ae51b52048c7979420b97a787da4)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:13.848832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:13.928152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1068/2163] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:13 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:13.928152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:13.929953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:14.003075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49467d1c-f125-4bd4-a269-b570a2204ed0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.007755 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.008437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.008670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.008942 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.009571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.011560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.039913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc1ae51b52048c7979420b97a787da4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.060895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc1ae51b52048c7979420b97a787da4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.071508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc1ae51b52048c7979420b97a787da4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.072325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc1ae51b52048c7979420b97a787da4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.112571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1069/2164] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:13 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:14.114197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.116003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:14.131586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6a755-9bdd-4df4-b84f-85d2b81ffb49 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.136060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.136694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.137004 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.137275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.137916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.139503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.154312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1070/2165] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:14.155274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.166293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe620c-e523-4a45-b23e-2963477650f9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.171029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.176197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.176312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc1ae51b52048c7979420b97a787da4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.176457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.176457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.176457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.176457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.184772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1096/2166] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:13 2022] DELETE /identity/v3/users/dcc1ae51b52048c7979420b97a787da4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:14.187025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1071/2167] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:14.191282 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.255186 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03315d03-3503-42ee-9186-5ed1cc976513 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.266231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45511eaf-badc-4d3e-a436-8313f6b95e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.266231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45511eaf-badc-4d3e-a436-8313f6b95e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.266231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45511eaf-badc-4d3e-a436-8313f6b95e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.266231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45511eaf-badc-4d3e-a436-8313f6b95e60 admin admin] PATH_INFO: `/v3/projects/b97d8c7cb2294467bd10d72cc8823e55/users/f62d085faf5145e4a115c0757187d210/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.266920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.269129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:14.286650 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45511eaf-badc-4d3e-a436-8313f6b95e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97d8c7cb2294467bd10d72cc8823e55, user_id=f62d085faf5145e4a115c0757187d210, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.290992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45511eaf-badc-4d3e-a436-8313f6b95e60 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.291695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f0848-2ede-4ca2-a7e5-2220f545319e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.295642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.296330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.296669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.297003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] PATH_INFO: `/v3/users/4553b7573ca34af6a9fdb94f80717f24` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.300260 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4553b7573ca34af6a9fdb94f80717f24)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.300903 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.372566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1097/2168] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:14 2022] PUT /identity/v3/projects/b97d8c7cb2294467bd10d72cc8823e55/users/f62d085faf5145e4a115c0757187d210/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:14.383916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.384205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.384670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.416984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] MFA Rules not processed for user `f62d085faf5145e4a115c0757187d210`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:14.418192 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:14.483280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1098/2169] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:14.487951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.540468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4553b7573ca34af6a9fdb94f80717f24'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.548298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4553b7573ca34af6a9fdb94f80717f24'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.549522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4553b7573ca34af6a9fdb94f80717f24'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.572124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00416ce9-bf39-4a8c-acdf-3db4a7389862 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.576824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.577434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.578453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.578453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.578640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.581091 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.648845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4553b7573ca34af6a9fdb94f80717f24'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.663896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4553b7573ca34af6a9fdb94f80717f24'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.668852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1099/2170] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:14 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:14.669747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.671686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:14.672597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1072/2171] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:14 2022] DELETE /identity/v3/users/4553b7573ca34af6a9fdb94f80717f24 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:14.673728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.675592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:14.754075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e131a-7407-4fec-b23c-1694b89d88af admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.761447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.764599 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.765931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.766237 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.766901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.770045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.771862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1bbdc-b729-40bb-9b44-e655f0281f62 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.778029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.778869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.779384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.779729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] PATH_INFO: `/v3/projects/cdcce88f934a4f3b834d059718ae2d79` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.782574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcce88f934a4f3b834d059718ae2d79)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.785394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:14.909721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1073/2172] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:14 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:14.914031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:14.924671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e57e22-e7a8-4db9-bb40-4f5918210e0c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:14.924846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcce88f934a4f3b834d059718ae2d79', 'request_id': 'req-f88284ae-250d-43cc-a508-a25cc9d6b5d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.931949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcce88f934a4f3b834d059718ae2d79', 'request_id': 'req-f88284ae-250d-43cc-a508-a25cc9d6b5d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:14.983251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:14.983888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:14.984082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:14.984445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:14.989640 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:14.992103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.008854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1074/2173] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:15.008854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.010672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.024718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067567-a598-428c-838a-5f231a2948d4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.029519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.030177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.030460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.030736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] PATH_INFO: `/v3/projects/480aef72b62f45e09f59cfa48ba9a854` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.031935 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480aef72b62f45e09f59cfa48ba9a854)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.033900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.036812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcce88f934a4f3b834d059718ae2d79', 'request_id': 'req-f88284ae-250d-43cc-a508-a25cc9d6b5d3'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.048407 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] The token cache is being invalidate because project cdcce88f934a4f3b834d059718ae2d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:15.048705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.049384 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.052646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1100/2174] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:14 2022] DELETE /identity/v3/projects/cdcce88f934a4f3b834d059718ae2d79 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:15.053417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.054836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.074456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88284ae-250d-43cc-a508-a25cc9d6b5d3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.080361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5776ed6-2f4f-4079-9674-3515599db029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.081811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776ed6-2f4f-4079-9674-3515599db029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.082090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776ed6-2f4f-4079-9674-3515599db029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.082364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5776ed6-2f4f-4079-9674-3515599db029 admin admin] PATH_INFO: `/v3/projects/de4657d8633f4cb6a47a94b52c18e4f0/users/8d314d02c0844687b1bbfa51758a617a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.096938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776ed6-2f4f-4079-9674-3515599db029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4657d8633f4cb6a47a94b52c18e4f0, user_id=8d314d02c0844687b1bbfa51758a617a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.099627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5776ed6-2f4f-4079-9674-3515599db029 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.248325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1101/2175] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:15 2022] PUT /identity/v3/projects/de4657d8633f4cb6a47a94b52c18e4f0/users/8d314d02c0844687b1bbfa51758a617a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:15.249533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.249815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.250095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.256703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480aef72b62f45e09f59cfa48ba9a854', 'request_id': 'req-cd4415d3-0f48-419a-b671-508f3e5fc9f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.262307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480aef72b62f45e09f59cfa48ba9a854', 'request_id': 'req-cd4415d3-0f48-419a-b671-508f3e5fc9f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.270163 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480aef72b62f45e09f59cfa48ba9a854', 'request_id': 'req-cd4415d3-0f48-419a-b671-508f3e5fc9f0'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.270310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:15.271386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.329590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1102/2176] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:15.330437 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.339436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a6f3-71f7-4e59-a514-24733ecf1332 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.344109 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.345669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.345970 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.346254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.347014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.348735 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.352043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] The token cache is being invalidate because project 480aef72b62f45e09f59cfa48ba9a854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:15.352532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.353345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-cd4415d3-0f48-419a-b671-508f3e5fc9f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:15.355102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1075/2177] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:15 2022] DELETE /identity/v3/projects/480aef72b62f45e09f59cfa48ba9a854 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:15.356701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756fc65-c2e8-4604-8b23-1bd7d024241e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.360922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756fc65-c2e8-4604-8b23-1bd7d024241e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.360922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756fc65-c2e8-4604-8b23-1bd7d024241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.361302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1103/2178] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:15.366311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.369240 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.380273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f756fc65-c2e8-4604-8b23-1bd7d024241e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:15.381857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f756fc65-c2e8-4604-8b23-1bd7d024241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.383862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007ee7d-52d7-458d-9fac-939c2397ffa0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.388565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.390008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.390008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.390008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] PATH_INFO: `/v3/projects/de4657d8633f4cb6a47a94b52c18e4f0/users/8d314d02c0844687b1bbfa51758a617a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.391671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4657d8633f4cb6a47a94b52c18e4f0, user_id=8d314d02c0844687b1bbfa51758a617a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.394326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.404052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1076/2179] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:15.405957 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.406355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.408269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1104/2180] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:15 2022] PUT /identity/v3/projects/de4657d8633f4cb6a47a94b52c18e4f0/users/8d314d02c0844687b1bbfa51758a617a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:15.409030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.412591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.437775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:15.439981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.481864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a7b8-cca9-44c1-ab73-b8cd620f5841 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.487829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.488470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.492810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.492810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.492810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:15.492810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.492810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcfb0a-9e89-44ed-bbba-5ec9a16f34a0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.506209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1105/2181] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:15.507461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a6ccd-0f56-4715-9df0-7f1275c87ed1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.507741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a6ccd-0f56-4715-9df0-7f1275c87ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.509597 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a6ccd-0f56-4715-9df0-7f1275c87ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.533190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1077/2182] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:15.534581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.547216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345e56e-08b9-493c-b922-c9c3443c0c0f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.550607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b19a6ccd-0f56-4715-9df0-7f1275c87ed1 None None] MFA Rules not processed for user `8d314d02c0844687b1bbfa51758a617a`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:15.552746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b19a6ccd-0f56-4715-9df0-7f1275c87ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.555303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.556073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.557806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.558214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.558928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.560774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.638257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1106/2183] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:15.639619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.639979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.640347 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.646474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:15.649279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1078/2184] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:15.651859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.653804 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.675448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:15.675448 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.723378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae849-59ea-45a7-b863-6d65959f7391 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.727425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.728218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.732026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.732026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.741679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1107/2185] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:15.742736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.754214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51bde6-f0c7-413f-8711-bb1d20426009 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.759354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.760045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.760330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.760698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.766539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.766539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.787173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:15.797748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.799291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.809854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1079/2186] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:15.810506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.820423 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba43c6b-4a1c-4849-a522-0ff96e9955cb service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.825251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.825750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.826053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.826302 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.826953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:15.827258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.828880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.841902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1080/2187] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:15.846127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.856687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9be63f-56cd-4841-b084-6267723aeeaf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.860523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1108/2188] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:15.864136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.866359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.867198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.867777 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.868276 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.869425 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.875966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.881179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a5321-e44e-4e1c-8660-646ea27824bb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.887781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.889090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.889500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.889786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.890445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.899246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.908561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1109/2189] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:15.913333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.928623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e60c0-69dd-4d0b-91de-217bb76d7c07 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.934048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.936253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.938368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.938582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.939245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:15.940925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:15.955722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1110/2190] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:15.955722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:15.964645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69991f-e1d0-4383-887c-a642edf128fa admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:15.968554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:15.969175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:15.969520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:15.969802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:15.972426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:15.980196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1081/2191] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:15 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:15.981810 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.053439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.055818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.063255 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275306e-285c-4bc7-873e-38cb60b44a65 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.068073 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1111/2192] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:16.068535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b81926-fc33-4266-860c-54a6a98db23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.068985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.069353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b81926-fc33-4266-860c-54a6a98db23b admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.069622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b81926-fc33-4266-860c-54a6a98db23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.069896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b81926-fc33-4266-860c-54a6a98db23b admin admin] PATH_INFO: `/v3/projects/9eb4bfc142594380b645dcdd95519d9c/users/7814b591eedd4793a03b38708bd2d640/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.085298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c2faa-9f3c-418d-821d-66ca74fc61c9 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.090496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b81926-fc33-4266-860c-54a6a98db23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb4bfc142594380b645dcdd95519d9c, user_id=7814b591eedd4793a03b38708bd2d640, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.091617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.092262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.092641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.092924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.093555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.094274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b81926-fc33-4266-860c-54a6a98db23b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.095458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.184950 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1082/2193] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:15 2022] PUT /identity/v3/projects/9eb4bfc142594380b645dcdd95519d9c/users/7814b591eedd4793a03b38708bd2d640/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:16.186368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.186655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.186938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.211372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1112/2194] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:16 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:16.215632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.218146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] MFA Rules not processed for user `7814b591eedd4793a03b38708bd2d640`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:16.219396 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:16.225871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983711a1-c589-4895-8f1c-fa0a8e3a030b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.283412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.283937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.284852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.284990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1083/2195] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:16.285125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.285792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.289124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.299141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1113/2196] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:16.303116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.314000 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268afe86-208b-413d-9a6f-af66eed5eb14 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.318711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.319331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.319613 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.319892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.320592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.322188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.333230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1084/2197] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:16.337247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.347950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48628017-9539-4af8-9d58-ee461610b4ca admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.352873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009ecd8-bfc1-4f87-950f-fb60a447ac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.353518 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009ecd8-bfc1-4f87-950f-fb60a447ac55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.353955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009ecd8-bfc1-4f87-950f-fb60a447ac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.354171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009ecd8-bfc1-4f87-950f-fb60a447ac55 admin admin] PATH_INFO: `/v3/projects/3e5e78253e0644f2a997cd840fd0a02f/users/849b1d8be8824866b98384fe97aea2af/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.369097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009ecd8-bfc1-4f87-950f-fb60a447ac55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5e78253e0644f2a997cd840fd0a02f, user_id=849b1d8be8824866b98384fe97aea2af, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.371769 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009ecd8-bfc1-4f87-950f-fb60a447ac55 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.433107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.434872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:16.449749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1114/2198] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:16 2022] PUT /identity/v3/projects/3e5e78253e0644f2a997cd840fd0a02f/users/849b1d8be8824866b98384fe97aea2af/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:16.461815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.462492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.462492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.491401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] MFA Rules not processed for user `849b1d8be8824866b98384fe97aea2af`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:16.492659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:16.512847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093aef-f7d5-44d2-b99f-b348d984dbac admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.580985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.580985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.580985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.580985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.582487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1115/2199] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:16.583607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.651111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.652652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.694252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1085/2200] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:14:16.695169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df5e65-9247-4765-aba5-0a6e0efc6695 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.695169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.695169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.695169 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.695583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.695583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.695583 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.719756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.732092 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49af0d-fcd7-41f5-a146-375e964dc5d0 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.737500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.738564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.738900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.744519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] PATH_INFO: `/v3/users/7814b591eedd4793a03b38708bd2d640` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.744519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7814b591eedd4793a03b38708bd2d640)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.744519 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:16.799491 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1116/2201] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:16 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:16.804218 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:16.879835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf2857-7832-44e3-9d70-4d2628b29a11 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:16.884856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:16.885455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:16.885733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:16.886003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:16.886630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:16.888584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.002879 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1117/2202] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:16 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:17.007646 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.010698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7814b591eedd4793a03b38708bd2d640'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:17.018477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7814b591eedd4793a03b38708bd2d640'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:17.019241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7814b591eedd4793a03b38708bd2d640'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:17.019844 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab979b9-c65c-4287-bf34-3caa1ede22e3 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.025853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.026462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.026747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.027031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.027681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.030124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.045158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1118/2203] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:17.047776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.049537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.063772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd08c8-7058-4b8e-95f1-e233dc4b5bd4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.073170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.074906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.074906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.074906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] PATH_INFO: `/v3/projects/ff109923dd5a40a5b2d943db28d945f1/users/d083222cd82449f0b1829b8a47807a61/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.090939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff109923dd5a40a5b2d943db28d945f1, user_id=d083222cd82449f0b1829b8a47807a61, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.093732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.147203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7814b591eedd4793a03b38708bd2d640'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:17.185053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-905544a4-d093-491e-b1a2-6e1b9679696c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7814b591eedd4793a03b38708bd2d640'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:17.191611 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1086/2204] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:16 2022] DELETE /identity/v3/users/7814b591eedd4793a03b38708bd2d640 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:17.197493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.197784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.198065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.215804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1119/2205] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:17 2022] PUT /identity/v3/projects/ff109923dd5a40a5b2d943db28d945f1/users/d083222cd82449f0b1829b8a47807a61/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:17.219937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:17.221563 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.222796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.300716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1087/2206] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:17.311229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.312177 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618137b8-7e19-4634-a841-a13024023660 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.312682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.317570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.318181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.318460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.318732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.319478 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.321019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.335022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1120/2207] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:17.336717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.357676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb2edf-e4fd-48b1-91fd-ce3a2d1f9e48 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.363544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067c62-8676-4064-bf6d-d76e96de6955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.364222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067c62-8676-4064-bf6d-d76e96de6955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.364543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067c62-8676-4064-bf6d-d76e96de6955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.364823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067c62-8676-4064-bf6d-d76e96de6955 admin admin] PATH_INFO: `/v3/projects/ff109923dd5a40a5b2d943db28d945f1/users/d083222cd82449f0b1829b8a47807a61/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.366831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1067c62-8676-4064-bf6d-d76e96de6955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff109923dd5a40a5b2d943db28d945f1, user_id=d083222cd82449f0b1829b8a47807a61, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.370458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1067c62-8676-4064-bf6d-d76e96de6955 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.380425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:17.393067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d92403-692b-4e70-8ebd-df7ff1a60222 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.402826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1121/2208] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:17 2022] PUT /identity/v3/projects/ff109923dd5a40a5b2d943db28d945f1/users/d083222cd82449f0b1829b8a47807a61/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:17.404337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.405034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.405034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.438017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] MFA Rules not processed for user `d083222cd82449f0b1829b8a47807a61`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:17.439674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.448989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.450137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.450584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.450873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.512272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.513023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1122/2209] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:17.513791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.524666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1088/2210] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:14:17.525395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.526893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.596031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a37e8-3e2d-4c86-84b7-e4adf6ff173c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.600776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.601674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.601921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.602196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.616058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.617591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.632367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1123/2211] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:14:17.752970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:17.862253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:17.863807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.877748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c90ee2-61b0-45c5-8875-eb1c250029cb service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:17.881977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:17.882578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:17.882858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:17.883131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:17.884918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:17.952251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:17.953065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03fe31-ae62-4541-9cf5-7415ef8df6bb service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:17.963286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1089/2212] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:18.031171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.032665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:18.046968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c04a5-b3ca-4db8-aa00-6176a4b54465 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.051792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.052468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.053264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.053556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] PATH_INFO: `/v3/projects/9eb4bfc142594380b645dcdd95519d9c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.054999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb4bfc142594380b645dcdd95519d9c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.057079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:18.196551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb4bfc142594380b645dcdd95519d9c', 'request_id': 'req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:18.202877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb4bfc142594380b645dcdd95519d9c', 'request_id': 'req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:18.283134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb4bfc142594380b645dcdd95519d9c', 'request_id': 'req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:18.293817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] The token cache is being invalidate because project 9eb4bfc142594380b645dcdd95519d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:18.294102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:18.294715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f5bf0e6b-97a6-452e-993f-df127ddf8f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:18.296253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1124/2213] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:18 2022] DELETE /identity/v3/projects/9eb4bfc142594380b645dcdd95519d9c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:18.301695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.302172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.302285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.322343 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:18.323556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:18.386272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1090/2214] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:18.394211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.394494 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.394796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.411550 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:18.417101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:18.418369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:18.426967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1125/2215] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:18.432959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.443877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62a11e-1b7f-4aba-a25e-a7a0b8e516c2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.449666 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.450387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.450742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.451014 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.451672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:18.451972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.453896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:18.495740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1091/2216] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:18.496630 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.508136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086d7bf-bfe5-4b73-b97f-f7955bbfbc1c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.513379 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.514037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.514289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.514571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.515395 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.517242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:18.625966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1126/2217] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:18 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:18.627132 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.637849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc47f3-6f91-42ab-b0c9-c13a87f58dba admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.703658 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.704242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.704559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.704838 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.705497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.707464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:18.724323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:18.802149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1092/2218] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:18 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:18.809023 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.819101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b727-b23e-4efa-ad35-ad1f2a8a7575 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.824754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.825480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.825815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.826038 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.826680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.828336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:18.838736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1127/2219] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:18.842745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.853230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faf75d-6687-4469-9a1b-84ac7a057bd1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.857780 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad56f29-df96-4cd9-8c0f-2a556a97dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.858477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56f29-df96-4cd9-8c0f-2a556a97dda3 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.858779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56f29-df96-4cd9-8c0f-2a556a97dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.859035 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad56f29-df96-4cd9-8c0f-2a556a97dda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.859670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad56f29-df96-4cd9-8c0f-2a556a97dda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.861339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad56f29-df96-4cd9-8c0f-2a556a97dda3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:18.874325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1093/2220] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:18.877973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:18.888229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd4467-41fd-4794-b76e-02d65b55860c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:18.893295 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849a65-1339-414f-b62d-f5485c735fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:18.897958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849a65-1339-414f-b62d-f5485c735fac admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:18.897958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849a65-1339-414f-b62d-f5485c735fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:18.897958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849a65-1339-414f-b62d-f5485c735fac admin admin] PATH_INFO: `/v3/projects/2116c786d085443693f6d9d585cc7673/users/34b7c58cfadb41889a508d4aa5560942/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:18.910022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849a65-1339-414f-b62d-f5485c735fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2116c786d085443693f6d9d585cc7673, user_id=34b7c58cfadb41889a508d4aa5560942, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:18.912706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849a65-1339-414f-b62d-f5485c735fac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:19.028746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:19.029071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:19.029348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:19.044287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1128/2221] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:18 2022] PUT /identity/v3/projects/2116c786d085443693f6d9d585cc7673/users/34b7c58cfadb41889a508d4aa5560942/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:19.049977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:19.051231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:19.117261 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:19.117513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:19.117763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:19.124592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1094/2222] 10.222.0.13 () {58 vars in 967 bytes} [Fri Oct 14 03:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:19.127444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:19.148342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:19.152262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:19.152372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] MFA Rules not processed for user `34b7c58cfadb41889a508d4aa5560942`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:19.152372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:19.221855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1129/2223] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:19.225583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a24e4-063a-4a8e-98fd-759c659c562a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:19.232544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:19.232544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:19.232544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:19.232544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:19.234652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:19.236141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:19.241287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:19.242885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:19.251144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1095/2224] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:14:19.289824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:19.294975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de612b8-485c-4234-b5b0-0faccf229c65 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:19.299001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac693a-96f7-441d-b82e-9fbd2e4b97f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:19.299642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac693a-96f7-441d-b82e-9fbd2e4b97f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:19.299917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac693a-96f7-441d-b82e-9fbd2e4b97f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:19.300281 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac693a-96f7-441d-b82e-9fbd2e4b97f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:19.309988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac693a-96f7-441d-b82e-9fbd2e4b97f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:19.311431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac693a-96f7-441d-b82e-9fbd2e4b97f8 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:19.321062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1130/2225] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:14:19.322504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:19.324026 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:19.370917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:19.398097 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442eaf5-c80f-4547-8add-7645db3e8bd1 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:19.403725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:19.404495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:19.405873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:19.405873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] PATH_INFO: `/v3/users/f62d085faf5145e4a115c0757187d210` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:19.406829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62d085faf5145e4a115c0757187d210)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:19.408818 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:19.617315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62d085faf5145e4a115c0757187d210'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:19.617315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62d085faf5145e4a115c0757187d210'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:19.617315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62d085faf5145e4a115c0757187d210'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:19.637879 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:19.710138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62d085faf5145e4a115c0757187d210'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:19.710898 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:19.728539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62d085faf5145e4a115c0757187d210'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:19.736497 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1096/2226] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:19 2022] DELETE /identity/v3/users/f62d085faf5145e4a115c0757187d210 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:19.741035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:19.741339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:19.741596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:19.760557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:19.761768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:19.843388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1131/2227] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:19.894689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:19.896574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:20.001143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832d5b3-b855-4697-b7bc-a34509056ba5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:20.010334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:20.011655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:20.012101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:20.012602 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:20.024073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:20.025896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:20.040447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1097/2228] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:20.290060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:20.369837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:20.639886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:20.641737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:20.689360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a232-6282-4c60-895e-b721d24050d6 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:20.694090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:20.694722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:20.695002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:20.695271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] PATH_INFO: `/v3/projects/b97d8c7cb2294467bd10d72cc8823e55` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:20.697029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97d8c7cb2294467bd10d72cc8823e55)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:20.698927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:20.703125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:20.816862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:20.834717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97d8c7cb2294467bd10d72cc8823e55', 'request_id': 'req-2b12399b-37bc-451b-89f0-686c429ac7a2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:20.841299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97d8c7cb2294467bd10d72cc8823e55', 'request_id': 'req-2b12399b-37bc-451b-89f0-686c429ac7a2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:20.921163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97d8c7cb2294467bd10d72cc8823e55', 'request_id': 'req-2b12399b-37bc-451b-89f0-686c429ac7a2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:20.932558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] The token cache is being invalidate because project b97d8c7cb2294467bd10d72cc8823e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:20.932873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:20.933520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:20.935230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1132/2229] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:20 2022] DELETE /identity/v3/projects/b97d8c7cb2294467bd10d72cc8823e55 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:20.939073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:20.949725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88728e-10eb-4fc7-a481-5383db17b54d service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:21.005056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:21.005694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:21.005975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:21.006248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] PATH_INFO: `/v3/users/8d314d02c0844687b1bbfa51758a617a` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:21.007398 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d314d02c0844687b1bbfa51758a617a)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:21.009368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:21.276054 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:21.309408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d314d02c0844687b1bbfa51758a617a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:21.328124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d314d02c0844687b1bbfa51758a617a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:21.330263 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d314d02c0844687b1bbfa51758a617a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:21.426657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d314d02c0844687b1bbfa51758a617a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:21.447010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-223a1c87-eb8f-457e-9c49-e2056e5bf070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d314d02c0844687b1bbfa51758a617a'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:21.453803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1098/2230] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:20 2022] DELETE /identity/v3/users/8d314d02c0844687b1bbfa51758a617a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:21.894991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:21.896778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:21.913798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12399b-37bc-451b-89f0-686c429ac7a2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:21.978765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:21.979562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:21.979933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:21.980268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] PATH_INFO: `/v3/projects/de4657d8633f4cb6a47a94b52c18e4f0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:21.981614 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4657d8633f4cb6a47a94b52c18e4f0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:21.983619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:21.986511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:22.152171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4657d8633f4cb6a47a94b52c18e4f0', 'request_id': 'req-ad598980-2ded-48ad-aefb-23ad8905a6bc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:22.158897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4657d8633f4cb6a47a94b52c18e4f0', 'request_id': 'req-ad598980-2ded-48ad-aefb-23ad8905a6bc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:22.225221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4657d8633f4cb6a47a94b52c18e4f0', 'request_id': 'req-ad598980-2ded-48ad-aefb-23ad8905a6bc'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:22.259081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] The token cache is being invalidate because project de4657d8633f4cb6a47a94b52c18e4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:22.259374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:22.260176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-ad598980-2ded-48ad-aefb-23ad8905a6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:22.261894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1133/2231] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:21 2022] DELETE /identity/v3/projects/de4657d8633f4cb6a47a94b52c18e4f0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:22.267102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.267723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.268112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.305888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:22.307333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:22.380739 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1099/2232] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:22.384383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.384698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.384973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.405637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:22.406870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:22.415990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1134/2233] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:22.420275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:22.456287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bac60-dc50-4d6d-8609-63fbe7fc8451 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:22.456287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:22.456287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.456287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.459826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.459826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:22.459826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:22.459826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:22.476953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1100/2234] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:14:22.481241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:22.505371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c6708-fc04-4e32-9fcf-3a296833eb41 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:22.513449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:22.513954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.517059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.517059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.517059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:22.517421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:22.536175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:22.635219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1135/2235] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:22 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:22.639276 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:22.650140 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208bca3-a4e0-4fb6-bb82-5d726e67e7f5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:22.711407 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:22.711937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.712221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.712525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.713172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:22.715113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:22.800200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1101/2236] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:22 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:22.803322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:22.813773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308786-c13e-42c6-b96d-002d932fd340 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:22.818993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:22.819648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.820123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.820433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.821093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:22.822700 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:22.833290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1136/2237] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:22.837211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:22.847191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6552-cd09-4bf2-bf2c-5e39c0351e05 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:22.852120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d699cae-dcd7-467b-81ca-e5c5dd81a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:22.852767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d699cae-dcd7-467b-81ca-e5c5dd81a83a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.853052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d699cae-dcd7-467b-81ca-e5c5dd81a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.853328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d699cae-dcd7-467b-81ca-e5c5dd81a83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.853983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d699cae-dcd7-467b-81ca-e5c5dd81a83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:22.855586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d699cae-dcd7-467b-81ca-e5c5dd81a83a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:22.866906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1102/2238] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:22.871157 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:22.881876 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353fd93-b823-4fba-95d6-f8de10dac8a0 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:22.886572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:22.887224 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:22.887655 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:22.887936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] PATH_INFO: `/v3/projects/1e6b195a5e6a4fbbb402602eb0a616d9/users/c6a5a5df0ccc4a809ab3dda42f84bae6/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:22.903253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e6b195a5e6a4fbbb402602eb0a616d9, user_id=c6a5a5df0ccc4a809ab3dda42f84bae6, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:22.906046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:22.991771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1137/2239] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:22 2022] PUT /identity/v3/projects/1e6b195a5e6a4fbbb402602eb0a616d9/users/c6a5a5df0ccc4a809ab3dda42f84bae6/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:23.003272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.003642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.003917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.032509 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] MFA Rules not processed for user `c6a5a5df0ccc4a809ab3dda42f84bae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:23.033827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:23.102064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1103/2240] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:23.106845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.175178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8d5b3-2b00-4fdf-8ef2-4ce5386f918a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.180737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.181340 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.181629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.181905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.182547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.184684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.273094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1138/2241] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:23 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:23.277143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.288418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a0bb6-4c1e-4efe-ba6b-721a190df99c None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.342436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.343032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.343307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.343577 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.344285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.346240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.449360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1104/2242] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:23 2022] POST /identity/v3/users => generated 301 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:23.453310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.463716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a263e-b4a9-43ce-bd77-01b7a780cff6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.468744 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.469351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.469634 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.469914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.470588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.472198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.483991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1139/2243] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:23.488312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.499349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e629b5-6941-473e-a4a2-90b596aa5cb4 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.504043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.504754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.505023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.505301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] PATH_INFO: `/v3/projects/813a420acc2d435fb98e077eb12976ab/users/84981dde0b994ff380fbdd8bafc8cd68/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.522892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813a420acc2d435fb98e077eb12976ab, user_id=84981dde0b994ff380fbdd8bafc8cd68, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.525677 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.608799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1105/2244] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:23 2022] PUT /identity/v3/projects/813a420acc2d435fb98e077eb12976ab/users/84981dde0b994ff380fbdd8bafc8cd68/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:23.611065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.616520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:23.623270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dd4fc-c9d4-40cd-9aef-fa17b57e9f70 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.684270 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90057f3a-9261-4122-bd5c-8a1db97e7252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.684904 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90057f3a-9261-4122-bd5c-8a1db97e7252 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.685199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90057f3a-9261-4122-bd5c-8a1db97e7252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.685461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90057f3a-9261-4122-bd5c-8a1db97e7252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.686118 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90057f3a-9261-4122-bd5c-8a1db97e7252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.687693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90057f3a-9261-4122-bd5c-8a1db97e7252 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.688205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:23.697309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1140/2245] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:23.701485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.712930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c8866-0336-4d02-8935-cd405068cde5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.717927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.718584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.718893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.719196 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] PATH_INFO: `/v3/projects/813a420acc2d435fb98e077eb12976ab/users/84981dde0b994ff380fbdd8bafc8cd68/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.721132 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813a420acc2d435fb98e077eb12976ab, user_id=84981dde0b994ff380fbdd8bafc8cd68, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.724451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.735985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1106/2246] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:23 2022] PUT /identity/v3/projects/813a420acc2d435fb98e077eb12976ab/users/84981dde0b994ff380fbdd8bafc8cd68/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:23.746305 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.746598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.746888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.779487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] MFA Rules not processed for user `84981dde0b994ff380fbdd8bafc8cd68`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:23.780907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:23.849193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1141/2247] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:23 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:23.887360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:23.889086 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:23.947235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c965d64-500b-4a66-8bbb-5d4b7857c7c3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:23.951084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c72fb4-ff30-449c-a9e8-1a42a7342cee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:23.951678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72fb4-ff30-449c-a9e8-1a42a7342cee service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:23.951961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72fb4-ff30-449c-a9e8-1a42a7342cee service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:23.952227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c72fb4-ff30-449c-a9e8-1a42a7342cee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:23.965915 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c72fb4-ff30-449c-a9e8-1a42a7342cee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:23.968870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c72fb4-ff30-449c-a9e8-1a42a7342cee service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:23.979452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1107/2248] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:24.149446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:24.215089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98d99e-40d7-4d96-8c97-431f3a752a5e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:24.219581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:24.220207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:24.220547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:24.220826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] PATH_INFO: `/v3/users/c6a5a5df0ccc4a809ab3dda42f84bae6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:24.221935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a5a5df0ccc4a809ab3dda42f84bae6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:24.223882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:24.428526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a5a5df0ccc4a809ab3dda42f84bae6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:24.436144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a5a5df0ccc4a809ab3dda42f84bae6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:24.448301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a5a5df0ccc4a809ab3dda42f84bae6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:24.448993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a5a5df0ccc4a809ab3dda42f84bae6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:24.527932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a5a5df0ccc4a809ab3dda42f84bae6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:24.534213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1142/2249] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:24 2022] DELETE /identity/v3/users/c6a5a5df0ccc4a809ab3dda42f84bae6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:24.541424 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:24.541814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:24.541981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:24.561675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:24.562929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:24.587865 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:24.626573 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1108/2250] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:24.637216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:24.638621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:24.713640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c62e-08b8-4aee-a97f-cdb64a872d8d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:24.717381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:24.717994 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:24.718269 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:24.718537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:24.728545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:24.730116 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:24.740561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1143/2251] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:24.779758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:25.204417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:25.204417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:25.215638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f92c4-0a36-49de-9d9c-aa3730f404c2 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:25.220329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:25.220998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:25.221272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:25.221543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] PATH_INFO: `/v3/projects/1e6b195a5e6a4fbbb402602eb0a616d9` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:25.223939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e6b195a5e6a4fbbb402602eb0a616d9)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:25.225991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:25.333332 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e6b195a5e6a4fbbb402602eb0a616d9', 'request_id': 'req-be722f71-8cfc-495c-b039-c67105452ccb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.338944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e6b195a5e6a4fbbb402602eb0a616d9', 'request_id': 'req-be722f71-8cfc-495c-b039-c67105452ccb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.345603 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e6b195a5e6a4fbbb402602eb0a616d9', 'request_id': 'req-be722f71-8cfc-495c-b039-c67105452ccb'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.409231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] The token cache is being invalidate because project 1e6b195a5e6a4fbbb402602eb0a616d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:25.409570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.410120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.411635 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1109/2252] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:25 2022] DELETE /identity/v3/projects/1e6b195a5e6a4fbbb402602eb0a616d9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:25.415545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:25.425102 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5aff69-a533-4858-aff8-c67188fffae1 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:25.482058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:25.482686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:25.482968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:25.488171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] PATH_INFO: `/v3/users/84981dde0b994ff380fbdd8bafc8cd68` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:25.488171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84981dde0b994ff380fbdd8bafc8cd68)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:25.488171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:25.704457 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84981dde0b994ff380fbdd8bafc8cd68'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.705642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:25.712544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84981dde0b994ff380fbdd8bafc8cd68'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.725667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84981dde0b994ff380fbdd8bafc8cd68'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.726388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84981dde0b994ff380fbdd8bafc8cd68'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.814324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f9b17dd2-c5bf-4bd4-974b-750f0824f862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84981dde0b994ff380fbdd8bafc8cd68'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:25.821781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1144/2253] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:25 2022] DELETE /identity/v3/users/84981dde0b994ff380fbdd8bafc8cd68 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:26.384212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:26.388428 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:26.400542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be722f71-8cfc-495c-b039-c67105452ccb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:26.462110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:26.462689 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:26.462975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:26.463252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] PATH_INFO: `/v3/projects/813a420acc2d435fb98e077eb12976ab` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:26.464381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=813a420acc2d435fb98e077eb12976ab)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:26.466354 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:26.562775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:26.574489 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813a420acc2d435fb98e077eb12976ab', 'request_id': 'req-7393be5b-eeff-48ad-81f0-37a631bddabc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:26.579920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813a420acc2d435fb98e077eb12976ab', 'request_id': 'req-7393be5b-eeff-48ad-81f0-37a631bddabc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:26.586902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813a420acc2d435fb98e077eb12976ab', 'request_id': 'req-7393be5b-eeff-48ad-81f0-37a631bddabc'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:26.676912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] The token cache is being invalidate because project 813a420acc2d435fb98e077eb12976ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:26.677207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:26.677856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-7393be5b-eeff-48ad-81f0-37a631bddabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:26.679378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1110/2254] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:26 2022] DELETE /identity/v3/projects/813a420acc2d435fb98e077eb12976ab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:26.684988 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:26.685456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:26.685570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:26.710466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:26.710466 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:26.769956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1145/2255] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:26.778467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:26.778774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:26.779049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:26.799328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:26.800584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:26.809197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1111/2256] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:26.813595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:26.823503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296945b2-eb9e-471b-be0f-40d8bf01c87e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:26.836436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:26.837140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:26.837833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:26.837833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:26.838462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:26.838805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:26.840621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:26.853462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1146/2257] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:26.857998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:26.867718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38f22d-6792-4264-aa40-a54c0b9fa2dd None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:26.872707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:26.873309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:26.873586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:26.873854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:26.874496 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:26.876418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.018671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1112/2258] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:26 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:27.023588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.034386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e624bd-cd2c-4bbc-bf3d-8af02b36703f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.099386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.100200 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.100603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.100966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.101629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.106595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.199214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1147/2259] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:27 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:27.200541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.211333 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14e315-c16b-4d78-b39c-06b9d949a3dd admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.215985 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.216626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.216913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.217194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.217846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.219448 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.232683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1113/2260] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:27.233869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.244025 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160a3e-1548-44b9-b956-492aee4483d9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.248568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8f6c2-a515-4579-aec2-de160d209302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.249172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8f6c2-a515-4579-aec2-de160d209302 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.249452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8f6c2-a515-4579-aec2-de160d209302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.249728 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8f6c2-a515-4579-aec2-de160d209302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.250373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8f6c2-a515-4579-aec2-de160d209302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.251954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8f6c2-a515-4579-aec2-de160d209302 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.263336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1148/2261] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:27.267472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.279066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a559e3-9a26-4a23-8add-81e4aba03013 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.284148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.284905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.285184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.285457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] PATH_INFO: `/v3/projects/934ab82fc0c042208cb5033cbb3f32b7/users/ad5555d7c9ab41f7b27cc92e5dead48f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.302657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] RBAC: Authorizing `identity:create_grant(project_id=934ab82fc0c042208cb5033cbb3f32b7, user_id=ad5555d7c9ab41f7b27cc92e5dead48f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.306275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.386653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1114/2262] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:27 2022] PUT /identity/v3/projects/934ab82fc0c042208cb5033cbb3f32b7/users/ad5555d7c9ab41f7b27cc92e5dead48f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:27.398316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.398623 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.398892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.440201 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] MFA Rules not processed for user `ad5555d7c9ab41f7b27cc92e5dead48f`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:27.441693 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:27.465399 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:27.514695 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1149/2263] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:27.519273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.578921 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.580709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:27.587318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a9125-2850-4735-8bb1-3cee180117df admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.592122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.592762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.593044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.599002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.599002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.599258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0c08a-9769-4eca-bd22-3601e4258de0 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.599360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.601933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.602680 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.603031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.603373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] PATH_INFO: `/v3/users/849b1d8be8824866b98384fe97aea2af` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.604688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=849b1d8be8824866b98384fe97aea2af)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.606668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.702082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1115/2264] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:27 2022] POST /identity/v3/projects => generated 381 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:27.705725 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.750444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:27.767111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d81d7-a741-45e7-a7c6-b51fdb34cb9d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.771826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.772716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.773001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.773274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.782591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.782591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.842075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849b1d8be8824866b98384fe97aea2af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:27.849487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849b1d8be8824866b98384fe97aea2af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:27.860434 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1116/2265] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:27 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:27.864004 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849b1d8be8824866b98384fe97aea2af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:27.864165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.865387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849b1d8be8824866b98384fe97aea2af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:27.866511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:27.878555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f830644-3775-4ee4-9375-604713484fd3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.883341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.883930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.884245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.887632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.887632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.887632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.897813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1117/2266] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:27.901934 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:27.911919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4466ec-1e0d-4f01-913b-7f27697a48ce admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:27.916547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:27.917156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.917432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.917703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] PATH_INFO: `/v3/projects/cc4ce54f48364947b5b5c1c693cb7d7a/users/31d0cf8590a2433e81d35a4a90ede20c/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.933031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4ce54f48364947b5b5c1c693cb7d7a, user_id=31d0cf8590a2433e81d35a4a90ede20c, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:27.935641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:27.959674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-11c9f2b2-e938-4867-b25d-01b1c273d02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849b1d8be8824866b98384fe97aea2af'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:27.965946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1150/2267] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:27 2022] DELETE /identity/v3/users/849b1d8be8824866b98384fe97aea2af => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:27.970289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:27.970577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:27.970852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:27.990314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:27.991519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:28.053558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1151/2268] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:28.058464 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1118/2269] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:27 2022] PUT /identity/v3/projects/cc4ce54f48364947b5b5c1c693cb7d7a/users/31d0cf8590a2433e81d35a4a90ede20c/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:28.062277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.064571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.066456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:28.073018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817ea0-f5c0-47dd-9bf1-6a849e31354a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:28.130186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6034-2650-41bf-a7db-95c19a30edd8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:28.134443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf5dd5-ef5e-43d9-9e82-bb20354708cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:28.135078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf5dd5-ef5e-43d9-9e82-bb20354708cc service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:28.135363 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf5dd5-ef5e-43d9-9e82-bb20354708cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:28.135560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:28.135700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf5dd5-ef5e-43d9-9e82-bb20354708cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:28.136178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:28.136486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:28.136761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:28.137587 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:28.139932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:28.145293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf5dd5-ef5e-43d9-9e82-bb20354708cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:28.147296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf5dd5-ef5e-43d9-9e82-bb20354708cc service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:28.149590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:28.153326 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1152/2270] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:28.164586 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.164742 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1119/2271] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:28.168309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707aca4-b990-4acb-b2f1-fb700b15276b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:28.173594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:28.174252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:28.174373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:28.174621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] PATH_INFO: `/v3/projects/cc4ce54f48364947b5b5c1c693cb7d7a/users/31d0cf8590a2433e81d35a4a90ede20c/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:28.177545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4ce54f48364947b5b5c1c693cb7d7a, user_id=31d0cf8590a2433e81d35a4a90ede20c, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:28.181812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:28.195415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1153/2272] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:28 2022] PUT /identity/v3/projects/cc4ce54f48364947b5b5c1c693cb7d7a/users/31d0cf8590a2433e81d35a4a90ede20c/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:28.205800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:28.206088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:28.206362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:28.238337 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] MFA Rules not processed for user `31d0cf8590a2433e81d35a4a90ede20c`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:28.239809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:28.318726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1120/2273] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:28.329314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.331421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:28.394831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33587-2997-446c-ac8c-f5d983647b4f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:28.399873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:28.400730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:28.401122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:28.401429 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:28.412853 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:28.414606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:28.426029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1154/2274] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:28.603157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.603773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:28.699296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:28.706541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf95aa-54be-479e-b383-50f06367d859 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:28.720650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:28.721421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:28.721833 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:28.722206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] PATH_INFO: `/v3/projects/3e5e78253e0644f2a997cd840fd0a02f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:28.723444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5e78253e0644f2a997cd840fd0a02f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:28.725654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:28.854809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5e78253e0644f2a997cd840fd0a02f', 'request_id': 'req-018a75fb-643c-49ff-bb66-848e69311d89'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:28.861751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5e78253e0644f2a997cd840fd0a02f', 'request_id': 'req-018a75fb-643c-49ff-bb66-848e69311d89'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:28.870639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5e78253e0644f2a997cd840fd0a02f', 'request_id': 'req-018a75fb-643c-49ff-bb66-848e69311d89'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:28.964117 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] The token cache is being invalidate because project 3e5e78253e0644f2a997cd840fd0a02f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:28.964546 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:28.965284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:28.970119 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1121/2275] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:28 2022] DELETE /identity/v3/projects/3e5e78253e0644f2a997cd840fd0a02f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:28.971285 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.980323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:28.982296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:28.983673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ad9b5-2a5e-4296-b842-1bacb0143d1a service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:29.053880 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a75fb-643c-49ff-bb66-848e69311d89 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:29.056467 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:29.057148 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:29.057433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:29.057765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] PATH_INFO: `/v3/users/d083222cd82449f0b1829b8a47807a61` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:29.058936 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d083222cd82449f0b1829b8a47807a61)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:29.059127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:29.059750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:29.060032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:29.060305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] PATH_INFO: `/v3/users/ad5555d7c9ab41f7b27cc92e5dead48f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:29.060934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:29.061513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5555d7c9ab41f7b27cc92e5dead48f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:29.063467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:29.264877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5555d7c9ab41f7b27cc92e5dead48f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.271755 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5555d7c9ab41f7b27cc92e5dead48f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.272470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5555d7c9ab41f7b27cc92e5dead48f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.274399 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:29.292781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd083222cd82449f0b1829b8a47807a61'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.301632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd083222cd82449f0b1829b8a47807a61'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.308605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:29.317035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd083222cd82449f0b1829b8a47807a61'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.317731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd083222cd82449f0b1829b8a47807a61'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.363443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5555d7c9ab41f7b27cc92e5dead48f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.376578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-930ad7ca-1780-466e-9eed-a427cad2be95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5555d7c9ab41f7b27cc92e5dead48f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.382522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1122/2276] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:28 2022] DELETE /identity/v3/users/ad5555d7c9ab41f7b27cc92e5dead48f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:29.386787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:29.387187 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:29.387535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:29.406866 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:29.408053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:29.420220 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd083222cd82449f0b1829b8a47807a61'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:29.431324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1155/2277] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:28 2022] DELETE /identity/v3/users/d083222cd82449f0b1829b8a47807a61 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:29.485545 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1123/2278] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:29.496045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:29.497772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:29.560417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2673c1-f948-48b9-a965-d974eb76692f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:29.564517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:29.565747 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:29.566082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:29.568924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:29.666503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:29.668312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:29.687003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1156/2279] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:30.091224 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:30.093542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:30.108025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5a3e-7a83-4c2f-b6c7-017f8f29c915 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:30.119652 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:30.121958 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.122256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.122709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] PATH_INFO: `/v3/projects/ff109923dd5a40a5b2d943db28d945f1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.124913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff109923dd5a40a5b2d943db28d945f1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:30.126891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:30.249831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff109923dd5a40a5b2d943db28d945f1', 'request_id': 'req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.256907 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff109923dd5a40a5b2d943db28d945f1', 'request_id': 'req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.263609 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff109923dd5a40a5b2d943db28d945f1', 'request_id': 'req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.311366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:30.313436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:30.329309 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881aa20-47cc-4e15-9145-faeed313a2a2 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:30.364051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] The token cache is being invalidate because project ff109923dd5a40a5b2d943db28d945f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:30.364463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.365157 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-333667a1-cccd-4bc2-9c4d-5e7bd5f86621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.367286 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1124/2280] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:30 2022] DELETE /identity/v3/projects/ff109923dd5a40a5b2d943db28d945f1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:30.371515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450056ef-53ca-4ee4-a5bb-d6104498ba56 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.371800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450056ef-53ca-4ee4-a5bb-d6104498ba56 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.372079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450056ef-53ca-4ee4-a5bb-d6104498ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.399674 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-450056ef-53ca-4ee4-a5bb-d6104498ba56 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:30.400930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-450056ef-53ca-4ee4-a5bb-d6104498ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:30.416999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:30.417787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.418070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.418338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] PATH_INFO: `/v3/projects/934ab82fc0c042208cb5033cbb3f32b7` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.419490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934ab82fc0c042208cb5033cbb3f32b7)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:30.421469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:30.456754 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:30.466592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1125/2281] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:30.474173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.475041 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.475314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.494791 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:30.495996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:30.504773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1126/2282] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:30.508277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:30.517369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bb1c-9226-467d-9c9d-681d5ce72e09 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:30.522447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:30.523016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.523548 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.523820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.524479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:30.524779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:30.526352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:30.529739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:30.538405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1127/2283] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:14:30.542535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:30.543740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934ab82fc0c042208cb5033cbb3f32b7', 'request_id': 'req-1230250f-dfa9-4f00-8521-1a1cc0365328'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.550249 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934ab82fc0c042208cb5033cbb3f32b7', 'request_id': 'req-1230250f-dfa9-4f00-8521-1a1cc0365328'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.551802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962df4-fcd9-4733-93de-5e3d3d7644cc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:30.607115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:30.607723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.608038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.608315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.608976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:30.610867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:30.620584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934ab82fc0c042208cb5033cbb3f32b7', 'request_id': 'req-1230250f-dfa9-4f00-8521-1a1cc0365328'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.632080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] The token cache is being invalidate because project 934ab82fc0c042208cb5033cbb3f32b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:30.632372 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.633031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.640176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1157/2284] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:30 2022] DELETE /identity/v3/projects/934ab82fc0c042208cb5033cbb3f32b7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:30.640176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:30.640176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:30.653324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230250f-dfa9-4f00-8521-1a1cc0365328 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:30.657918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:30.658539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.658820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.659094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] PATH_INFO: `/v3/users/31d0cf8590a2433e81d35a4a90ede20c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.660274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31d0cf8590a2433e81d35a4a90ede20c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:30.662329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:30.765787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1128/2285] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:30 2022] POST /identity/v3/projects => generated 357 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:30.769954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:30.772203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:30.841402 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ec988-4005-47f6-976b-4d7007424af0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:30.846277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:30.846882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:30.847219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:30.847498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:30.848127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:30.851210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:30.893635 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31d0cf8590a2433e81d35a4a90ede20c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.901872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31d0cf8590a2433e81d35a4a90ede20c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.920838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31d0cf8590a2433e81d35a4a90ede20c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.920838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31d0cf8590a2433e81d35a4a90ede20c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:30.994859 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1129/2286] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:30 2022] POST /identity/v3/users => generated 279 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:30.998936 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.000554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:31.012297 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31d0cf8590a2433e81d35a4a90ede20c'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:31.013916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefd2eb-cebb-49e2-9bc9-de3412474152 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.018784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.018960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1158/2287] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:30 2022] DELETE /identity/v3/users/31d0cf8590a2433e81d35a4a90ede20c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:31.023802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.024197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.024749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.025512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.027703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.039457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1130/2288] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:31.043511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.114553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd9cdf-0390-4cbe-b030-efa9f65beb34 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.119843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da37a-0baa-4c11-b7ff-9d303ecff9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.120489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da37a-0baa-4c11-b7ff-9d303ecff9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.120803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da37a-0baa-4c11-b7ff-9d303ecff9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.121064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da37a-0baa-4c11-b7ff-9d303ecff9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.121677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2da37a-0baa-4c11-b7ff-9d303ecff9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.123375 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2da37a-0baa-4c11-b7ff-9d303ecff9ea admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.133878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1159/2289] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:31.138155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.148102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb52c-25a3-4796-bc3e-f712a185b4b0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.152986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.153632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.153914 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.154193 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] PATH_INFO: `/v3/projects/952767fcbc27482d854343dce6521432/users/bfc111e5d6354413b9542e6c41f33c78/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.168347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952767fcbc27482d854343dce6521432, user_id=bfc111e5d6354413b9542e6c41f33c78, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.171010 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.279435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1131/2290] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:31 2022] PUT /identity/v3/projects/952767fcbc27482d854343dce6521432/users/bfc111e5d6354413b9542e6c41f33c78/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:31.287303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.287590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.287941 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.318729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] MFA Rules not processed for user `bfc111e5d6354413b9542e6c41f33c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:31.319937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:31.385930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1160/2291] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:31.390400 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.448199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.449631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:31.456245 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79651b0-f2da-40a3-8418-2f5110ea7599 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.463177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.463845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.464063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.464340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.465040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.465202 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e1000-d695-421b-8458-a7acdf79f490 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.467050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.472828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.473499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.473808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.474080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] PATH_INFO: `/v3/projects/cc4ce54f48364947b5b5c1c693cb7d7a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.475463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4ce54f48364947b5b5c1c693cb7d7a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.477656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.601809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1132/2292] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:31 2022] POST /identity/v3/projects => generated 355 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:31.605770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.639020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4ce54f48364947b5b5c1c693cb7d7a', 'request_id': 'req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:31.645198 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4ce54f48364947b5b5c1c693cb7d7a', 'request_id': 'req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:31.675029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6f03-e46f-4756-ab66-a8b90c682ecf admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.730614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.731219 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.731500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.731773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.732416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.734339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.744083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4ce54f48364947b5b5c1c693cb7d7a', 'request_id': 'req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:31.755292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] The token cache is being invalidate because project cc4ce54f48364947b5b5c1c693cb7d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:31.763819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:31.763819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-af013c00-2d11-4f6d-8fad-0925aa5aa4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:31.763819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1161/2293] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:31 2022] DELETE /identity/v3/projects/cc4ce54f48364947b5b5c1c693cb7d7a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:31.763819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ffd08-2575-4308-9b50-ca8a7f36e963 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.764212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ffd08-2575-4308-9b50-ca8a7f36e963 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.764316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ffd08-2575-4308-9b50-ca8a7f36e963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.784845 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-987ffd08-2575-4308-9b50-ca8a7f36e963 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:31.786077 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-987ffd08-2575-4308-9b50-ca8a7f36e963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:31.794088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1162/2294] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:31.803209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.803493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.803765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.812274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1133/2295] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:31 2022] POST /identity/v3/users => generated 284 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:31.815972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.817614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:31.826720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:31.828150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:31.830195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b4bd-dc44-435f-80fb-50660e899412 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.837149 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1163/2296] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:31.839226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.839836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.840115 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.840453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.841223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.841739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.842832 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.851654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a0803-5050-41ec-bc51-ab62224a8068 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.857030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1134/2297] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:31.857213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.857213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.857213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.857544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.858012 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:31.858311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.859751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.859889 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.870003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a28bf3-954f-4a0a-add5-364debc1a079 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.875811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1164/2298] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:14:31.875969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.875969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.876327 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.876622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] PATH_INFO: `/v3/projects/c60bdfcd30a945cdb48e4f7421c763fb/users/4fbf2f4c25f84a20b68be3e3eb5ef553/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.877030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:31.890870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fec739-22a6-4691-8d57-a81dcd0f9d90 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:31.892869 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60bdfcd30a945cdb48e4f7421c763fb, user_id=4fbf2f4c25f84a20b68be3e3eb5ef553, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.895604 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:31.895751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:31.897066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:31.897475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:31.901998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:31.901998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:31.901998 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.022977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1135/2299] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:31 2022] PUT /identity/v3/projects/c60bdfcd30a945cdb48e4f7421c763fb/users/4fbf2f4c25f84a20b68be3e3eb5ef553/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:32.023321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1165/2300] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:31 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:32.027183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.028412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.112815 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bfcd6-3537-47fe-ad6d-5c94d0537c2e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.117252 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02603294-c5bc-496c-ba3c-ae5bac36734b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.117382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.118013 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.118359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.118571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.119312 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.120939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.122533 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.123238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.123584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.123934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.124739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.126852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.132073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1136/2301] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:14:32.136147 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.154747 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c537d32-00a7-4ab1-b911-839f290f663f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.160360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14f9ab-2733-4a65-83f1-0add1efa7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.161063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14f9ab-2733-4a65-83f1-0add1efa7a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.161344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14f9ab-2733-4a65-83f1-0add1efa7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.161621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14f9ab-2733-4a65-83f1-0add1efa7a58 admin admin] PATH_INFO: `/v3/projects/c60bdfcd30a945cdb48e4f7421c763fb/users/4fbf2f4c25f84a20b68be3e3eb5ef553/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.163595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14f9ab-2733-4a65-83f1-0add1efa7a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60bdfcd30a945cdb48e4f7421c763fb, user_id=4fbf2f4c25f84a20b68be3e3eb5ef553, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.166355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14f9ab-2733-4a65-83f1-0add1efa7a58 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.177258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1137/2302] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:32 2022] PUT /identity/v3/projects/c60bdfcd30a945cdb48e4f7421c763fb/users/4fbf2f4c25f84a20b68be3e3eb5ef553/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:32.187300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.187590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.187873 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.217448 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] MFA Rules not processed for user `4fbf2f4c25f84a20b68be3e3eb5ef553`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:32.218696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.225161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:32.257402 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1166/2303] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:32 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:32.263974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.266787 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.296216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1138/2304] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:32.297181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.328973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3e37-89c7-44be-aa89-b565e473eca1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.358718 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e285d3f-0e68-47e6-99bf-9d5123abdc98 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.363422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.363947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.364230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.364537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.365182 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.366824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.376544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1139/2305] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:32.377422 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.378317 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.378933 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.379191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.379298 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.379811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.382423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.442438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd20cee-cd2c-4541-a20a-debf7e8bad7d admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.447507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.448275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.448672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.449038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.451837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.453311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.460174 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.461653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.463622 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1167/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:32.464458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.470561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:32.472247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1140/2307] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:32.475670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f590fd-d8a5-4ace-90a3-9f6e73421739 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.481391 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30d4e4-51a6-45e4-b0ab-9262445104dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.481991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d4e4-51a6-45e4-b0ab-9262445104dd admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.482272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d4e4-51a6-45e4-b0ab-9262445104dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.482545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d4e4-51a6-45e4-b0ab-9262445104dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.483486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30d4e4-51a6-45e4-b0ab-9262445104dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.485930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30d4e4-51a6-45e4-b0ab-9262445104dd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.500489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1168/2308] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:32.502484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.513921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c090-d513-4c1e-b93a-6bee35bb0d4b service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.518846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.519569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.519917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.520262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] PATH_INFO: `/v3/projects/8a6abc4190064185a8ee7cf30af2c81d/users/7f71f767519849dbba449bbaeb7a8206/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.537240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6abc4190064185a8ee7cf30af2c81d, user_id=7f71f767519849dbba449bbaeb7a8206, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.539900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.620482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1141/2309] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:32 2022] PUT /identity/v3/projects/8a6abc4190064185a8ee7cf30af2c81d/users/7f71f767519849dbba449bbaeb7a8206/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:32.629506 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.629803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.630133 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.659089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] MFA Rules not processed for user `7f71f767519849dbba449bbaeb7a8206`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:32.660357 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.715565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.731122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1169/2310] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:32.743061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:32.744726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.778270 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7197a-c13c-4728-abd1-76f9cc8434c0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.782221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.782830 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.783134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.783455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.785379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:32.814717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504938a-ce82-4e06-a657-e1c0d253be55 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:32.819653 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:32.820272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:32.820644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:32.820929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:32.832020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.833804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.843916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1170/2311] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:32.850837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:32.852473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:32.864598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1142/2312] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:14:32.946651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:33.406806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:33.623870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:34.456341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:34.564132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:34.566089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:34.645106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236abc6-33fd-4256-8f8d-e7006e8299ca service glance] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:34.658092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:34.658736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:34.659124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:34.659758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:34.661503 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:34.674874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:34.676598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e83a9-17e6-46a8-bec5-c4e18b259443 service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:34.688126 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1171/2313] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:44.321211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:44.812145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=76 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:51.614876 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:51.682044 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8591160-4b9d-429b-ae3f-3a0923140950 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:51.686517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:51.687161 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:51.687437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:51.687727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] PATH_INFO: `/v3/users/bfc111e5d6354413b9542e6c41f33c78` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:51.688982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc111e5d6354413b9542e6c41f33c78)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:51.691571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:51.892536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc111e5d6354413b9542e6c41f33c78'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:51.899472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc111e5d6354413b9542e6c41f33c78'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:51.900214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc111e5d6354413b9542e6c41f33c78'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.010267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc111e5d6354413b9542e6c41f33c78'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.024061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc111e5d6354413b9542e6c41f33c78'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.031271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1143/2314] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:51 2022] DELETE /identity/v3/users/bfc111e5d6354413b9542e6c41f33c78 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:52.036410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:52.036887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:52.037019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:52.057814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:52.059046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:52.118799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1172/2315] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:52.129108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:52.130778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:52.190172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97852795-acef-4cf5-9849-0d6d62c98954 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:52.193764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:52.194362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:52.194668 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:52.194939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:52.203623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:52.205108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:52.214764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1144/2316] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:52.635463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:52.636930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:52.652344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be884dcc-4d0f-48f8-ab63-36d5b478dacc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:52.661888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:52.662138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:52.662450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:52.662725 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] PATH_INFO: `/v3/projects/952767fcbc27482d854343dce6521432` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:52.664051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] RBAC: Authorizing `identity:delete_project(project_id=952767fcbc27482d854343dce6521432)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:52.666093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:52.822709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952767fcbc27482d854343dce6521432', 'request_id': 'req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.828965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952767fcbc27482d854343dce6521432', 'request_id': 'req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.884504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952767fcbc27482d854343dce6521432', 'request_id': 'req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.896366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] The token cache is being invalidate because project 952767fcbc27482d854343dce6521432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:52.896677 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.897351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:52.898891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1173/2317] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:52 2022] DELETE /identity/v3/projects/952767fcbc27482d854343dce6521432 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:52.903242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:52.913806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3435d04-5b69-4b81-8236-7e5956eea1ad service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:52.933671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:52.973536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:52.974391 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:52.974664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:52.974938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] PATH_INFO: `/v3/users/4fbf2f4c25f84a20b68be3e3eb5ef553` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:52.976101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbf2f4c25f84a20b68be3e3eb5ef553)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:52.978072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:53.115738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbf2f4c25f84a20b68be3e3eb5ef553'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.122685 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbf2f4c25f84a20b68be3e3eb5ef553'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.123340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbf2f4c25f84a20b68be3e3eb5ef553'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.199728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbf2f4c25f84a20b68be3e3eb5ef553'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.212503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-dde67e13-51db-4edf-92cd-7e41dc1d84da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbf2f4c25f84a20b68be3e3eb5ef553'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.218271 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1145/2318] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:52 2022] DELETE /identity/v3/users/4fbf2f4c25f84a20b68be3e3eb5ef553 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:53.639999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:53.641502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:53.658119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c61d-0bcc-4ceb-9006-e23ffc6d732d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:53.728871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:53.729508 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:53.729930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:53.730072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] PATH_INFO: `/v3/projects/c60bdfcd30a945cdb48e4f7421c763fb` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:53.731273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60bdfcd30a945cdb48e4f7421c763fb)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:53.733221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:53.817513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:53.833924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60bdfcd30a945cdb48e4f7421c763fb', 'request_id': 'req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.840035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60bdfcd30a945cdb48e4f7421c763fb', 'request_id': 'req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.913018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60bdfcd30a945cdb48e4f7421c763fb', 'request_id': 'req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.923762 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] The token cache is being invalidate because project c60bdfcd30a945cdb48e4f7421c763fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:53.924124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.924759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c6bfaacd-0c61-450c-b52f-eeb357d99ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:53.926263 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1174/2319] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:53 2022] DELETE /identity/v3/projects/c60bdfcd30a945cdb48e4f7421c763fb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:53.932499 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:53.933022 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:53.933135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:53.952624 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:53.953812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:54.012632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1146/2320] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:54.021504 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.021801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.022083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.042945 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:54.044147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:54.051977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1175/2321] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:54.056817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.066616 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb3173-1985-4264-96de-075ab48be333 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.071323 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.071918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.072201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.072514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.073162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:14:54.073472 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.075122 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.086526 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1147/2322] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:14:54.090710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.100626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626ceb2-27ef-4b49-8ae0-2eab7b482ab1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.105332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.105981 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.106248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.106522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.107165 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.109090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.185975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1176/2323] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:54 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:54.190307 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.200051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd81a8b-d551-4f70-bb02-5e883a86aa75 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.225615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:54.255409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.256020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.256493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.257077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.257756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.259650 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.335898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1148/2324] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:54 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:54.340196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.350982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786582c-aeda-4c02-a21b-f99ed480eaf2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.355581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.356195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.356511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.356786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.357424 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.359017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.369408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1177/2325] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:54.373482 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.383394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f51d62-6962-47f4-9a0f-9bf2f755087c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.387912 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4952b2-8821-421f-ab94-8b25738d11ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.388543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4952b2-8821-421f-ab94-8b25738d11ca admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.388824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4952b2-8821-421f-ab94-8b25738d11ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.389095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4952b2-8821-421f-ab94-8b25738d11ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.389728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4952b2-8821-421f-ab94-8b25738d11ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.391326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4952b2-8821-421f-ab94-8b25738d11ca admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.401845 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1149/2326] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:54.406262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.416847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440656f6-648b-4db5-a71d-210b64ea87fc admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.421385 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.422022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.422303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.422581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] PATH_INFO: `/v3/projects/281f40fa498440789bb590dbd37c3143/users/c186b7d832a9498e8409272925e2d530/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.437099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=281f40fa498440789bb590dbd37c3143, user_id=c186b7d832a9498e8409272925e2d530, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.439797 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.518917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1178/2327] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:54 2022] PUT /identity/v3/projects/281f40fa498440789bb590dbd37c3143/users/c186b7d832a9498e8409272925e2d530/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:14:54.530268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.530556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.530834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.559020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] MFA Rules not processed for user `c186b7d832a9498e8409272925e2d530`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:54.560373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:54.627408 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1150/2328] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:54.634576 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.696866 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4b021-7d39-4902-974a-33e8c8315b4a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.701631 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.702232 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.702517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.702792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.703425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.705368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.802887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1179/2329] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:14:54 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:14:54.804206 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:54.819772 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a55d-ddcb-4836-9890-ce8fefb11489 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:54.870831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:54.871373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:54.871654 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:54.871925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:54.872578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:54.874515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:54.988017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1151/2330] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:14:54 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:14:54.989962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:55.000359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1919a47-4fd6-4942-a87b-5fae7e3c63a1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:55.005974 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:55.006605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:55.006918 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:55.007221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:55.007860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:55.009493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:55.019871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1180/2331] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:55.024707 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:55.034952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae914c4-78c5-4ebd-9eab-c63541afe92e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:55.039762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:55.040341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:55.040648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:55.040923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] PATH_INFO: `/v3/projects/b31287e368564e3d8c1fdcbcd4f30e82/users/f2544d608bae4eb5bf05d585d7295d5a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:55.056205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31287e368564e3d8c1fdcbcd4f30e82, user_id=f2544d608bae4eb5bf05d585d7295d5a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:55.058986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:55.133978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1152/2332] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:55 2022] PUT /identity/v3/projects/b31287e368564e3d8c1fdcbcd4f30e82/users/f2544d608bae4eb5bf05d585d7295d5a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:55.137815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:55.148694 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840abc36-901e-49bc-a205-2d124359a9c6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:55.169095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:55.205485 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a99f-fbb4-4fea-89ae-78f68c83f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:55.206084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a99f-fbb4-4fea-89ae-78f68c83f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:55.206371 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a99f-fbb4-4fea-89ae-78f68c83f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:55.206644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a99f-fbb4-4fea-89ae-78f68c83f3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:55.207299 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a99f-fbb4-4fea-89ae-78f68c83f3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:55.208969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a99f-fbb4-4fea-89ae-78f68c83f3d1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:55.218514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1181/2333] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:14:55.222704 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:55.228047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:55.233292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a8780-8282-49cf-833d-f011a1396051 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:55.237899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:55.238543 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:55.238825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:55.239103 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] PATH_INFO: `/v3/projects/b31287e368564e3d8c1fdcbcd4f30e82/users/f2544d608bae4eb5bf05d585d7295d5a/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:55.241536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31287e368564e3d8c1fdcbcd4f30e82, user_id=f2544d608bae4eb5bf05d585d7295d5a, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:55.244235 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:55.254121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1153/2334] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:14:55 2022] PUT /identity/v3/projects/b31287e368564e3d8c1fdcbcd4f30e82/users/f2544d608bae4eb5bf05d585d7295d5a/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:55.264746 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:55.265057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:55.265333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:55.293481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] MFA Rules not processed for user `f2544d608bae4eb5bf05d585d7295d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:55.294711 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:55.365553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1182/2335] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:14:55.376264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:55.377982 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:55.436210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48aba-8f72-456f-a14a-134a7af84be1 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:55.439765 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc5e79-5565-4f11-8ef2-2c09299d65d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:55.440358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc5e79-5565-4f11-8ef2-2c09299d65d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:55.440669 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc5e79-5565-4f11-8ef2-2c09299d65d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:55.440940 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc5e79-5565-4f11-8ef2-2c09299d65d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:55.495214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc5e79-5565-4f11-8ef2-2c09299d65d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:55.496680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc5e79-5565-4f11-8ef2-2c09299d65d1 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:55.505322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1154/2336] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:57.510015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:57.511616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:57.577897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0fdb6-8be4-4270-b0b8-27fc41eb2235 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:57.582502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:57.583125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:57.583406 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:57.583679 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] PATH_INFO: `/v3/users/7f71f767519849dbba449bbaeb7a8206` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:57.585322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f71f767519849dbba449bbaeb7a8206)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:57.591062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:57.793078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f71f767519849dbba449bbaeb7a8206'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:57.794306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:57.800882 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f71f767519849dbba449bbaeb7a8206'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:57.813236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f71f767519849dbba449bbaeb7a8206'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:57.813986 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f71f767519849dbba449bbaeb7a8206'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:57.888958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f71f767519849dbba449bbaeb7a8206'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:57.895382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1183/2337] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:14:57 2022] DELETE /identity/v3/users/7f71f767519849dbba449bbaeb7a8206 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:57.900565 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:57.901036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:57.901148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:57.919947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:14:57.921191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:57.979559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1155/2338] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:14:57.989515 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:57.990954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:58.049388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0b4d9-8263-45a1-919c-f482582739d6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:58.053018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:58.059450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:58.059450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:58.059450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:58.063443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:58.065013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:58.075290 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1184/2339] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:14:58.472444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:58.473877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:58.485729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd6332-fc99-4ab6-9a26-5b329bd824ec None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:58.491212 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:14:58.491868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:14:58.492176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:14:58.492480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] PATH_INFO: `/v3/projects/8a6abc4190064185a8ee7cf30af2c81d` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:14:58.493672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6abc4190064185a8ee7cf30af2c81d)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:14:58.495579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:14:58.613690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:14:58.621152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6abc4190064185a8ee7cf30af2c81d', 'request_id': 'req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:58.626738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6abc4190064185a8ee7cf30af2c81d', 'request_id': 'req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:58.633031 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6abc4190064185a8ee7cf30af2c81d', 'request_id': 'req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:58.722840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] The token cache is being invalidate because project 8a6abc4190064185a8ee7cf30af2c81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:14:58.723131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:58.723761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:14:58.725806 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1156/2340] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:14:58 2022] DELETE /identity/v3/projects/8a6abc4190064185a8ee7cf30af2c81d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:14:59.892686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:14:59.894161 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:14:59.951617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d7f76-2985-4907-8729-771eb2a19d73 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:14:59.999649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:00.000243 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:00.000552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:00.000826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:00.002748 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:00.044459 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:00.070615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:00.072068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b50d3-bdb5-4e0c-bd16-79201333a6a1 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:00.082401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1185/2341] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:14:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:03.784568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:03.787642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:03.861156 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac41f8-029b-4ea1-b9e2-ea4f9f065575 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:03.869315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:03.870675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:03.870675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:03.870675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] PATH_INFO: `/v3/users/34b7c58cfadb41889a508d4aa5560942` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:03.871601 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b7c58cfadb41889a508d4aa5560942)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:03.873678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:04.091590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b7c58cfadb41889a508d4aa5560942'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:04.100258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b7c58cfadb41889a508d4aa5560942'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:04.100864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b7c58cfadb41889a508d4aa5560942'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:04.202171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b7c58cfadb41889a508d4aa5560942'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:04.217208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b7c58cfadb41889a508d4aa5560942'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:04.223403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1157/2342] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:03 2022] DELETE /identity/v3/users/34b7c58cfadb41889a508d4aa5560942 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:04.228686 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:04.229173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:04.229173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:04.248268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:04.249469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:04.308964 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1186/2343] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:04.318622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:04.320138 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:04.376902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:04.382114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50472506-a77f-4f37-b70f-ab2231dd94ae admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:04.385857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459290e-66b7-44f2-b056-bd7774b81c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:04.389248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459290e-66b7-44f2-b056-bd7774b81c43 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:04.389248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459290e-66b7-44f2-b056-bd7774b81c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:04.389248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459290e-66b7-44f2-b056-bd7774b81c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:04.395881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459290e-66b7-44f2-b056-bd7774b81c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:04.397342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459290e-66b7-44f2-b056-bd7774b81c43 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:04.407384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1158/2344] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:04.813147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:04.814569 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:04.826798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54d81b-9608-4895-a3db-177b9e2a7098 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:04.832702 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:04.833676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:04.834082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:04.834532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] PATH_INFO: `/v3/projects/2116c786d085443693f6d9d585cc7673` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:04.835916 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2116c786d085443693f6d9d585cc7673)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:04.837907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:04.965275 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2116c786d085443693f6d9d585cc7673', 'request_id': 'req-0898e354-93af-4ca9-86c1-d3c314b7eec0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:04.971816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2116c786d085443693f6d9d585cc7673', 'request_id': 'req-0898e354-93af-4ca9-86c1-d3c314b7eec0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:05.029196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2116c786d085443693f6d9d585cc7673', 'request_id': 'req-0898e354-93af-4ca9-86c1-d3c314b7eec0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:05.041591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] The token cache is being invalidate because project 2116c786d085443693f6d9d585cc7673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:05.041884 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:05.042526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-0898e354-93af-4ca9-86c1-d3c314b7eec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:05.044014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1187/2345] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:04 2022] DELETE /identity/v3/projects/2116c786d085443693f6d9d585cc7673 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:05.049517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.050356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.050665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.070216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:05.071353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:05.129529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1159/2346] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:05.138716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.139005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.139315 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.160516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:05.161721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:05.170665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1188/2347] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:05.175042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.184888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f7dcc-8f5d-42dd-8b64-fb9e4a53ddc0 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.190186 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.190840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.190840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.190840 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.191466 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:05.191774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.193581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.209358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1160/2348] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:05.211341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.223822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd6525-6cb4-47df-840f-b81c68b78a27 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.230142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.230142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.230820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.230820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.231257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.233190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.392358 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1189/2349] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:05 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:05.393492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.408445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d1f16-5ac2-4a01-8ef7-fa63f9d6cec0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.471627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.472230 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.472541 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.472928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.473571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.475494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.596314 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1161/2350] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:05 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:05.600613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.611510 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7fd0b-8e9d-43d8-9364-da42214a896e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.616174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.616862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.617657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.617928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.618573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.620190 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.634640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1190/2351] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:05.636135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.646514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba06a-efd0-4994-88a8-4ea18059e506 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.651708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547f06d-0859-4047-a8e2-d63345fb099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.652335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f06d-0859-4047-a8e2-d63345fb099f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.652715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f06d-0859-4047-a8e2-d63345fb099f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.652984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547f06d-0859-4047-a8e2-d63345fb099f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.653775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547f06d-0859-4047-a8e2-d63345fb099f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.655386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547f06d-0859-4047-a8e2-d63345fb099f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.666419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1162/2352] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:05.670966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.682445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570ef37-bb70-48dc-90ea-343d7a132473 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.687238 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.688005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.688354 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.688740 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] PATH_INFO: `/v3/projects/81844e70cf0f4a18935958f953d256ca/users/4a725ecc054e4b5a98c21de694671d3f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.705861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81844e70cf0f4a18935958f953d256ca, user_id=4a725ecc054e4b5a98c21de694671d3f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.708675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.711144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:05.774033 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1191/2353] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:05 2022] PUT /identity/v3/projects/81844e70cf0f4a18935958f953d256ca/users/4a725ecc054e4b5a98c21de694671d3f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:05.784812 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.785104 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.785377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.813655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] MFA Rules not processed for user `4a725ecc054e4b5a98c21de694671d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:05.814854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:05.859716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:05.880901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1163/2354] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:05.892798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:05.894716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:05.955187 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f09352-61fd-4676-80e2-a1870c2b6498 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:05.958888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbec8a-f3aa-48bc-9ecd-e339c055f14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:05.959499 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbec8a-f3aa-48bc-9ecd-e339c055f14d service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:05.959836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbec8a-f3aa-48bc-9ecd-e339c055f14d service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:05.960106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbec8a-f3aa-48bc-9ecd-e339c055f14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:05.968637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbec8a-f3aa-48bc-9ecd-e339c055f14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:05.970080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbec8a-f3aa-48bc-9ecd-e339c055f14d service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:05.979578 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1192/2355] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:06.005351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:06.074412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e85b27-d425-410e-a28b-7cfc4de9e52f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:06.079512 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:06.080799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:06.080799 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:06.088592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] PATH_INFO: `/v3/users/4a725ecc054e4b5a98c21de694671d3f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:06.088592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a725ecc054e4b5a98c21de694671d3f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:06.088592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:06.296971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a725ecc054e4b5a98c21de694671d3f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:06.307238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a725ecc054e4b5a98c21de694671d3f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:06.308114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a725ecc054e4b5a98c21de694671d3f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:06.375756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a725ecc054e4b5a98c21de694671d3f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:06.388783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a725ecc054e4b5a98c21de694671d3f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:06.394693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1164/2356] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:06 2022] DELETE /identity/v3/users/4a725ecc054e4b5a98c21de694671d3f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:06.399857 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:06.400336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:06.400470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:06.420139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:06.421446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:06.480753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1193/2357] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:06.490184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:06.491579 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:06.550919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574be1ab-f772-41e3-851e-f6a55ca02628 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:06.555892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3030a-1d1b-4831-8f4a-1d1267902b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:06.556638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3030a-1d1b-4831-8f4a-1d1267902b54 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:06.562151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3030a-1d1b-4831-8f4a-1d1267902b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:06.562151 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3030a-1d1b-4831-8f4a-1d1267902b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:06.577458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3030a-1d1b-4831-8f4a-1d1267902b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:06.578908 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3030a-1d1b-4831-8f4a-1d1267902b54 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:06.595522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1165/2358] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:07.022525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.024561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:07.036854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c71710-63cd-4c54-a76b-17c5bd0b6aef None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.041834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.047667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.047667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.047667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] PATH_INFO: `/v3/projects/81844e70cf0f4a18935958f953d256ca` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.047667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81844e70cf0f4a18935958f953d256ca)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.047667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.177103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81844e70cf0f4a18935958f953d256ca', 'request_id': 'req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:07.184123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81844e70cf0f4a18935958f953d256ca', 'request_id': 'req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:07.278422 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81844e70cf0f4a18935958f953d256ca', 'request_id': 'req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:07.290343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] The token cache is being invalidate because project 81844e70cf0f4a18935958f953d256ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:07.290632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:07.291259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b2c51121-e0af-47e6-a25a-2696d4e4b3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:07.292796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1194/2359] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:07 2022] DELETE /identity/v3/projects/81844e70cf0f4a18935958f953d256ca => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:07.297634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.298091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.298266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.312101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:07.318046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:07.319231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:07.377813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1166/2360] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:07.385449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.385763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.386048 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.406223 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:07.407419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:07.416005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1195/2361] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:07.420278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.431623 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f05c4-7abb-4274-b61e-a02162675329 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.436598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.437197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.437476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.437745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.438387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:07.438687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.440273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.453570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1167/2362] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:07.457821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.467642 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939c679-2d8f-40ed-b15c-c71117ded2a4 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.472277 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.472900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.473183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.473458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.474121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.476029 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.487803 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:07.550719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1196/2363] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:07 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:07.554973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.564798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd89c9-0737-44e6-8fe3-3edf288b2635 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.629023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.629751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.630162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.630592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.631234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.633887 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.759800 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1168/2364] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:07 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:07.764119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.775455 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac6dda-6b9f-4311-9c04-8ad849be3124 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.780284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.781206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.781488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.781777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.782405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.786913 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.797203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1197/2365] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:07.798621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.812276 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a92e12-234c-4439-af83-78f062fa92de admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.817452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd8001-c91e-47de-a9f8-c76251452a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.818070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd8001-c91e-47de-a9f8-c76251452a9f admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.818353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd8001-c91e-47de-a9f8-c76251452a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.818624 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd8001-c91e-47de-a9f8-c76251452a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.819387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd8001-c91e-47de-a9f8-c76251452a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.824561 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd8001-c91e-47de-a9f8-c76251452a9f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.833316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1169/2366] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:07.839751 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:07.849590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c611e33-aedf-445f-9036-e041173abd96 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:07.855272 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:07.855930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.856214 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.856526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] PATH_INFO: `/v3/projects/6117dd60941f4804899175ecf89aefa4/users/20ecd6112f824d4eafb2f51518b5e873/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:07.872055 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6117dd60941f4804899175ecf89aefa4, user_id=20ecd6112f824d4eafb2f51518b5e873, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:07.874805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:07.967801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1198/2367] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:07 2022] PUT /identity/v3/projects/6117dd60941f4804899175ecf89aefa4/users/20ecd6112f824d4eafb2f51518b5e873/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:07.978855 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:07.979170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:07.979665 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:08.007440 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] MFA Rules not processed for user `20ecd6112f824d4eafb2f51518b5e873`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:08.009275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:08.076554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1170/2368] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:08.087342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:08.089111 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:08.152488 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04227f3f-6a99-4f85-940b-971824d4df98 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:08.156633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a39eab-d897-414c-9714-db34eaef5e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:08.157245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39eab-d897-414c-9714-db34eaef5e45 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:08.157555 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39eab-d897-414c-9714-db34eaef5e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:08.157835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a39eab-d897-414c-9714-db34eaef5e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:08.166246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39eab-d897-414c-9714-db34eaef5e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:08.167678 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a39eab-d897-414c-9714-db34eaef5e45 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:08.176423 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1199/2369] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:09.062783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:09.064183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:09.069232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:09.126229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6351a-d2f5-4b8d-86f5-167f44343655 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:09.131384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:09.132019 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:09.132282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:09.132583 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:09.134390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:09.199671 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:09.201190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:09.210882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1171/2370] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:09.922330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:09.922883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:09.922883 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:09.942009 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] MFA Rules not processed for user `20ecd6112f824d4eafb2f51518b5e873`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:09.950553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:09.951058 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1200/2371] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:13.288524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:13.292077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:13.368024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94930c0f-4961-4c09-a4fd-76f25074efba service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:13.373510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:13.374066 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:13.374347 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:13.374622 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:13.376651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:13.388966 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:13.390591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:13.417617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1172/2372] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:13.419389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:13.421593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:13.440558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c45cf-208b-4ee8-82b6-d4e890709caf None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:13.445730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:13.446590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:13.446870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:13.447292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] PATH_INFO: `/v3/users/1201fb5f14154b048f5c55bd566e91b9` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:13.448827 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1201fb5f14154b048f5c55bd566e91b9)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:13.450831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:13.853871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1201fb5f14154b048f5c55bd566e91b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:13.861595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1201fb5f14154b048f5c55bd566e91b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:13.874937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1201fb5f14154b048f5c55bd566e91b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:13.875823 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1201fb5f14154b048f5c55bd566e91b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:13.942513 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1d2bc653-fc02-47fe-8dc1-f6076e2309f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1201fb5f14154b048f5c55bd566e91b9'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:13.949815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1201/2373] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:13 2022] DELETE /identity/v3/users/1201fb5f14154b048f5c55bd566e91b9 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:14.261778 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:14.286384 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5640ab7-a444-4914-a9fa-749f7fe305bb service placement] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:14.337648 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:14.358267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:14.359444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:14.359444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:14.359889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] PATH_INFO: `/v3/projects/b28c1645ea1f4941ab2d016ad313ae6b` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:14.361109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28c1645ea1f4941ab2d016ad313ae6b)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:14.363298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:14.474274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28c1645ea1f4941ab2d016ad313ae6b', 'request_id': 'req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:14.481490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28c1645ea1f4941ab2d016ad313ae6b', 'request_id': 'req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:14.487932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28c1645ea1f4941ab2d016ad313ae6b', 'request_id': 'req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:14.570756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] The token cache is being invalidate because project b28c1645ea1f4941ab2d016ad313ae6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:14.571167 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:14.571774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-eefe7ad2-13d2-4a54-afbc-43ac58b5aaaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:14.573330 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1173/2374] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:14 2022] DELETE /identity/v3/projects/b28c1645ea1f4941ab2d016ad313ae6b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:14.578741 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:14.579287 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:14.579416 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:14.601930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:14.603140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:14.625675 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:14.685404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1202/2375] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:14.693857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:14.694152 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:14.694437 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:14.715350 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:14.716734 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:14.724700 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1174/2376] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:14.729733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:14.739468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01bca1-8c77-47bf-b40a-b96ceeda02d3 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:14.744057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:14.744754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:14.745028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:14.745493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:14.746150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:14.746452 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:14.748181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:14.760296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1203/2377] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:14.764975 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:14.775024 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e98393-7a28-4b24-b01d-437ad467381e None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:14.780468 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:14.781084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:14.781366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:14.781639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:14.782555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:14.784632 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:14.897500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1175/2378] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:14 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:14.898819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:14.910997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe626e39-b8f5-41c8-a2e4-119d6a8252cd admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:14.972366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:14.973022 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:14.973304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:14.973657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:14.974312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:14.977262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.048626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1204/2379] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:14 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:15.052836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.063279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd9ded-abcc-4932-84e0-b941f8100c09 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.067927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.068617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.068899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.069171 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.069904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.071478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.082578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1176/2380] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:15.086428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.097297 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855ce4-5286-4756-ae1f-2b11daa4a65f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.101946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c6f81-36df-4cc3-94ae-c480642d7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.102548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6f81-36df-4cc3-94ae-c480642d7363 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.102833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6f81-36df-4cc3-94ae-c480642d7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.103106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c6f81-36df-4cc3-94ae-c480642d7363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.104443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c6f81-36df-4cc3-94ae-c480642d7363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.106045 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c6f81-36df-4cc3-94ae-c480642d7363 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.117414 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1205/2381] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:15.122064 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.132807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1f58b-b9d0-4921-aad0-b16d8fa96244 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.138070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.144268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.144268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.144268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] PATH_INFO: `/v3/projects/9bce8b8370be41f2ba225de34f4ab70c/users/c1faec77f7b046c093f617bccc24d1b0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.154900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bce8b8370be41f2ba225de34f4ab70c, user_id=c1faec77f7b046c093f617bccc24d1b0, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.157960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.281185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1177/2382] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:15 2022] PUT /identity/v3/projects/9bce8b8370be41f2ba225de34f4ab70c/users/c1faec77f7b046c093f617bccc24d1b0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:15.292765 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.295909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.295909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.324174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] MFA Rules not processed for user `c1faec77f7b046c093f617bccc24d1b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:15.325425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:15.404019 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1206/2383] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:15.404943 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.406328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.406927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:15.432284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:15.482329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfbdac-ff6b-4eb9-86ca-0efcdbb3bf03 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.500475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665d8a-ec10-4377-bab1-2100a1666e9e None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.500606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.500606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.500606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.500606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] PATH_INFO: `/v3/users/c186b7d832a9498e8409272925e2d530` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.500931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c186b7d832a9498e8409272925e2d530)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.500931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.501097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.501097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.501097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.501097 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.501445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.501445 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.505210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:15.593672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1207/2384] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:15 2022] POST /identity/v3/projects => generated 369 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:15.597613 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.660266 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31530c9c-2f8d-4d8c-bbf6-004148f4030c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.665350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.665930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.666206 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.667095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.667730 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.672196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.698459 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c186b7d832a9498e8409272925e2d530'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:15.707310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c186b7d832a9498e8409272925e2d530'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:15.710983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c186b7d832a9498e8409272925e2d530'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:15.771439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c186b7d832a9498e8409272925e2d530'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:15.779935 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1208/2385] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:15 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:15.788782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.788782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:15.789045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-b9659bfd-b686-4ef5-93cb-72fe05bce415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c186b7d832a9498e8409272925e2d530'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:15.793451 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1178/2386] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:15 2022] DELETE /identity/v3/users/c186b7d832a9498e8409272925e2d530 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:15.798273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.798748 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.799217 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.801826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efe1ca-acc9-4e54-8a90-5d5d4eddee20 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.818540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:15.819846 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:15.864870 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.869130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.869130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.869130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.869130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.869130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.879135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1209/2387] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:15.884570 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.886998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1179/2388] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:15.895469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41883b4-028d-4f81-8c56-865da8e1f4fb admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.897582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:15.898960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:15.900362 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.905667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.905667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.905667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] PATH_INFO: `/v3/projects/ab416b628dba4c71b3fb04b62f32b14e/users/adfbbf39348f4f2caac80e11ed8d3124/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.921610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab416b628dba4c71b3fb04b62f32b14e, user_id=adfbbf39348f4f2caac80e11ed8d3124, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.925114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.961413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2e3da-ebac-4db0-bb33-56a735e390c9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:15.965634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:15.966274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:15.966615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:15.966827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:15.976091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:15.977566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:15.987046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1180/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:15:16.009526 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1210/2390] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:15 2022] PUT /identity/v3/projects/ab416b628dba4c71b3fb04b62f32b14e/users/adfbbf39348f4f2caac80e11ed8d3124/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:16.014121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:16.024970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e4d09-e01e-4066-9537-809f33080330 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:16.065920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:16.095536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618bcf1-700c-4e6c-a892-0f3b06d7a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:16.096233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bcf1-700c-4e6c-a892-0f3b06d7a52e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:16.096593 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bcf1-700c-4e6c-a892-0f3b06d7a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:16.096928 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618bcf1-700c-4e6c-a892-0f3b06d7a52e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:16.097638 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bcf1-700c-4e6c-a892-0f3b06d7a52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:16.099331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618bcf1-700c-4e6c-a892-0f3b06d7a52e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:16.109160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1181/2391] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:16.113663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:16.125008 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae1be-fa7e-434d-9d04-23b1be9a327b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:16.129887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:16.130542 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:16.130819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:16.131094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] PATH_INFO: `/v3/projects/ab416b628dba4c71b3fb04b62f32b14e/users/adfbbf39348f4f2caac80e11ed8d3124/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:16.133108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab416b628dba4c71b3fb04b62f32b14e, user_id=adfbbf39348f4f2caac80e11ed8d3124, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:16.136670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:16.139123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:16.148136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1211/2392] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:16 2022] PUT /identity/v3/projects/ab416b628dba4c71b3fb04b62f32b14e/users/adfbbf39348f4f2caac80e11ed8d3124/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:16.159809 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:16.160093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:16.160364 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:16.194048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] MFA Rules not processed for user `adfbbf39348f4f2caac80e11ed8d3124`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:16.195318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:16.274764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1182/2393] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:16.286331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:16.289031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:16.355925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307cb96-efdd-41f1-9c84-4bb33d48834a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:16.363065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:16.363742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:16.364021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:16.364291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:16.375511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:16.377141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:16.392810 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1212/2394] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:16.433448 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:16.435308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:16.509651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441357e-9db8-427d-bee2-e8f20b103e49 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:16.514474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:16.515112 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:16.515394 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:16.516100 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] PATH_INFO: `/v3/projects/281f40fa498440789bb590dbd37c3143` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:16.516857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=281f40fa498440789bb590dbd37c3143)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:16.518774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:16.643417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281f40fa498440789bb590dbd37c3143', 'request_id': 'req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:16.647322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:16.649595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281f40fa498440789bb590dbd37c3143', 'request_id': 'req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:16.655773 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281f40fa498440789bb590dbd37c3143', 'request_id': 'req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:16.734029 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] The token cache is being invalidate because project 281f40fa498440789bb590dbd37c3143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:16.737919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:16.737919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:16.737919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1183/2395] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:16 2022] DELETE /identity/v3/projects/281f40fa498440789bb590dbd37c3143 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:16.740594 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:16.751669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30d004-7f3c-4fb2-b5d5-6bc091fb8a5f service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:16.812264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:16.812931 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:16.813212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:16.813489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] PATH_INFO: `/v3/users/f2544d608bae4eb5bf05d585d7295d5a` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:16.814615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2544d608bae4eb5bf05d585d7295d5a)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:16.816563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:17.013796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2544d608bae4eb5bf05d585d7295d5a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.021323 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2544d608bae4eb5bf05d585d7295d5a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.034688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2544d608bae4eb5bf05d585d7295d5a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.035404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2544d608bae4eb5bf05d585d7295d5a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.102596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-41edfc67-63b0-4108-9fac-040b8efa109b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2544d608bae4eb5bf05d585d7295d5a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.109325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1213/2396] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:16 2022] DELETE /identity/v3/users/f2544d608bae4eb5bf05d585d7295d5a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:17.513900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:17.515357 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:17.536535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb2b2-3230-4ccf-a4ef-2d124c0335e5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:17.603109 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:17.603823 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:17.604234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:17.604656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] PATH_INFO: `/v3/projects/b31287e368564e3d8c1fdcbcd4f30e82` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:17.606229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31287e368564e3d8c1fdcbcd4f30e82)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:17.608220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:17.720562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31287e368564e3d8c1fdcbcd4f30e82', 'request_id': 'req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.726203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31287e368564e3d8c1fdcbcd4f30e82', 'request_id': 'req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.733254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31287e368564e3d8c1fdcbcd4f30e82', 'request_id': 'req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.817053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] The token cache is being invalidate because project b31287e368564e3d8c1fdcbcd4f30e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:17.817345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.817984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-212cbff9-2f4b-4826-944c-f7adaf7dbc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:17.819460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1184/2397] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:17 2022] DELETE /identity/v3/projects/b31287e368564e3d8c1fdcbcd4f30e82 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:17.825061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:17.825539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:17.825645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:17.844990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:17.854995 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:17.856539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:17.910869 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1214/2398] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:17.917794 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:17.918078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:17.918353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:17.938705 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:17.939917 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:17.947994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1185/2399] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:17.952888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:17.962654 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f91d2-9cbe-42b3-90dd-3565420f1134 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:17.967143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:17.967781 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:17.968063 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:17.968341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:17.969017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:17.969322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:17.970953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:17.982954 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1215/2400] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:17.987085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:17.996927 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb90afa-b68d-4de4-b3f7-db5bbb8f3b58 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.001527 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.002121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.002406 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.002683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.003315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.005976 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:18.147651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1186/2401] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:17 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:18.151771 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:18.162321 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd73519-26cc-40af-b53a-905ad716848a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.220973 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.221577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.221856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.222134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.222795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.224833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:18.340831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1216/2402] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:18 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:18.344938 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:18.355731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c05bd-7952-476b-92db-2033bdd5b98f admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.360383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.361016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.361328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.361597 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.362267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.363837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:18.379093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1187/2403] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:18.381863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:18.393493 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7ff0d-3aa7-468a-9b33-54b0694a315c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.399103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d265209-5596-4632-b669-c170ce30dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.399704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265209-5596-4632-b669-c170ce30dfaa admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.399980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265209-5596-4632-b669-c170ce30dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.400251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265209-5596-4632-b669-c170ce30dfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.400927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265209-5596-4632-b669-c170ce30dfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.403093 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d265209-5596-4632-b669-c170ce30dfaa admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:18.420083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1217/2404] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:18.424881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:18.434919 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ae486-14bb-4cd7-beed-962ec50e1800 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.439542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.440184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.440688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.440971 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] PATH_INFO: `/v3/projects/054ae5b809974ca7971578a830f9f2a4/users/178f192a30d544089f4e0fc2102465bb/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.455067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=054ae5b809974ca7971578a830f9f2a4, user_id=178f192a30d544089f4e0fc2102465bb, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.457726 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:18.517409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1188/2405] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:18 2022] PUT /identity/v3/projects/054ae5b809974ca7971578a830f9f2a4/users/178f192a30d544089f4e0fc2102465bb/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:18.532689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.533401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.533806 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.562992 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] MFA Rules not processed for user `178f192a30d544089f4e0fc2102465bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:18.564264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:18.633512 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1218/2406] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:18.642124 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:18.648634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:18.718146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbcc56-cb9c-4741-951f-72273a4e8fbb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.722881 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.723516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.723796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.724071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.726706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.726706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:18.833744 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1189/2407] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:18 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:18.837824 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:18.849965 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4c5b-1db5-4a9b-a61a-1caff08babba None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:18.859280 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:18.911236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:18.911843 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:18.912125 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:18.912417 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:18.913049 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:18.918490 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.093095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1219/2408] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:18 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:19.096964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.106973 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279b97-78a5-47b9-8311-cadfbb8e41b5 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.111492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.112083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.112404 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.112683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.113485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.115088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.129294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1190/2409] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:19.133146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.146666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82cf9-4702-4f2b-81f5-b6cc6f2c890b admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.151942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.152722 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.153005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.153288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] PATH_INFO: `/v3/projects/9f6ba372237a4520903e38c8fb019be2/users/3d536894c75048e0b617dd3cb93f38f4/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.168671 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6ba372237a4520903e38c8fb019be2, user_id=3d536894c75048e0b617dd3cb93f38f4, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.171259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.260492 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1220/2410] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:19 2022] PUT /identity/v3/projects/9f6ba372237a4520903e38c8fb019be2/users/3d536894c75048e0b617dd3cb93f38f4/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:19.265133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.278149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ed671-7504-4815-9c32-a2d0f9248989 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.289900 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.292268 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:19.349882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.350495 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.350774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.351052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.351691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.353959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.365724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc581f-9b0c-4da7-8acf-1ebf52769ddf admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.365946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1191/2411] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:19.370249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.371441 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.372075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.372361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.372666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] PATH_INFO: `/v3/users/c1faec77f7b046c093f617bccc24d1b0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.373896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1faec77f7b046c093f617bccc24d1b0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.375818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.381020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874598-8f40-4ec9-8b0e-924abcd8ed21 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.385856 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec6eb6-2738-42cd-b995-e8350034bb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.387048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6eb6-2738-42cd-b995-e8350034bb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.387334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6eb6-2738-42cd-b995-e8350034bb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.387651 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec6eb6-2738-42cd-b995-e8350034bb07 admin admin] PATH_INFO: `/v3/projects/9f6ba372237a4520903e38c8fb019be2/users/3d536894c75048e0b617dd3cb93f38f4/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.389954 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6eb6-2738-42cd-b995-e8350034bb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6ba372237a4520903e38c8fb019be2, user_id=3d536894c75048e0b617dd3cb93f38f4, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.392678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aec6eb6-2738-42cd-b995-e8350034bb07 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.404039 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1192/2412] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:19 2022] PUT /identity/v3/projects/9f6ba372237a4520903e38c8fb019be2/users/3d536894c75048e0b617dd3cb93f38f4/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:19.415485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.415774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.416050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.444826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] MFA Rules not processed for user `3d536894c75048e0b617dd3cb93f38f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:19.445979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:19.499991 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:19.519308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1193/2413] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:19.530009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.531356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:19.577520 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1faec77f7b046c093f617bccc24d1b0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:19.584846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1faec77f7b046c093f617bccc24d1b0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:19.590617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e2f41-5eef-4f93-87c3-301378cd4612 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.595342 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1040d-4188-406e-886c-454bc6d905b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.595965 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1040d-4188-406e-886c-454bc6d905b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.596242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1040d-4188-406e-886c-454bc6d905b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.596560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1040d-4188-406e-886c-454bc6d905b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.598003 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1faec77f7b046c093f617bccc24d1b0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:19.598688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1faec77f7b046c093f617bccc24d1b0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:19.602366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:19.653960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1040d-4188-406e-886c-454bc6d905b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.655412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1040d-4188-406e-886c-454bc6d905b2 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.665360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1194/2414] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:15:19.694727 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1faec77f7b046c093f617bccc24d1b0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:19.701265 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1221/2415] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:19 2022] DELETE /identity/v3/users/c1faec77f7b046c093f617bccc24d1b0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:19.705988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.706281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.706560 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.725712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:19.726951 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:19.791782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1195/2416] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:19.802566 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:19.804568 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:19.865888 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95880f8c-7fb9-4288-a320-9bf18826a178 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:19.869644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:19.870251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:19.870549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:19.870821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:19.884339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:19.885920 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:19.896922 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1222/2417] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:20.386894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:20.389127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:20.405105 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f2f68-6e66-4cf9-b437-d5b238f1f50d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:20.410461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:20.413656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:20.413656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:20.413656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] PATH_INFO: `/v3/projects/9bce8b8370be41f2ba225de34f4ab70c` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:20.413656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bce8b8370be41f2ba225de34f4ab70c)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:20.415749 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:20.514102 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:20.520813 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bce8b8370be41f2ba225de34f4ab70c', 'request_id': 'req-34b713ac-cfe4-4b94-954d-e4ddf32a7474'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.528657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bce8b8370be41f2ba225de34f4ab70c', 'request_id': 'req-34b713ac-cfe4-4b94-954d-e4ddf32a7474'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.535442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bce8b8370be41f2ba225de34f4ab70c', 'request_id': 'req-34b713ac-cfe4-4b94-954d-e4ddf32a7474'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.613884 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] The token cache is being invalidate because project 9bce8b8370be41f2ba225de34f4ab70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:20.614181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.614862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.616372 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1196/2418] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:20 2022] DELETE /identity/v3/projects/9bce8b8370be41f2ba225de34f4ab70c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:20.621067 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:20.630541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde42fed-477f-4ef8-9775-97d12a3343c1 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:20.689956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:20.690669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:20.690968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:20.691248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] PATH_INFO: `/v3/users/adfbbf39348f4f2caac80e11ed8d3124` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:20.692353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfbbf39348f4f2caac80e11ed8d3124)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:20.694353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:20.865770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfbbf39348f4f2caac80e11ed8d3124'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.873179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfbbf39348f4f2caac80e11ed8d3124'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.885194 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfbbf39348f4f2caac80e11ed8d3124'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:20.885867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfbbf39348f4f2caac80e11ed8d3124'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.017522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-b4c83e64-f9b0-4f1d-bb76-ba0e8eb183c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfbbf39348f4f2caac80e11ed8d3124'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.023838 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1223/2419] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:20 2022] DELETE /identity/v3/users/adfbbf39348f4f2caac80e11ed8d3124 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:21.454614 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:21.455920 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:21.473091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b713ac-cfe4-4b94-954d-e4ddf32a7474 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:21.558268 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:21.560612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:21.564201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:21.564201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] PATH_INFO: `/v3/projects/ab416b628dba4c71b3fb04b62f32b14e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:21.566924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab416b628dba4c71b3fb04b62f32b14e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:21.568901 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:21.691011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab416b628dba4c71b3fb04b62f32b14e', 'request_id': 'req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.697458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab416b628dba4c71b3fb04b62f32b14e', 'request_id': 'req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.703947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab416b628dba4c71b3fb04b62f32b14e', 'request_id': 'req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.812353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] The token cache is being invalidate because project ab416b628dba4c71b3fb04b62f32b14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:21.812750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.813432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-d7ccb823-fb3a-4b94-9c08-cbcaea88fc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:21.814956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1197/2420] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:21 2022] DELETE /identity/v3/projects/ab416b628dba4c71b3fb04b62f32b14e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:21.819860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:21.820230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:21.820612 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:21.848656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:21.850034 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:21.864262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:21.916893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1224/2421] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:21.924678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:21.924970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:21.925248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:21.944803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:21.945994 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:21.954351 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1198/2422] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:21.958609 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:21.969016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95738263-34f7-441d-90e4-e1e56044d3ae None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:21.973596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:21.974212 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:21.974479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:21.974753 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:21.975403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:21.975706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:21.977373 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:21.989145 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1225/2423] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:15:21.993820 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.003386 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed39615-6752-407e-964a-92c5ab493e47 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.008479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.009160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.009438 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.009728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.010474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.013018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.122984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1199/2424] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:21 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:22.127117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.137656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3ce18-a857-45af-979f-91d2f54d284c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.192985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.193588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.193919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.194296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.194911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.196840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.287242 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1226/2425] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:22 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:22.291463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.301764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd4344-327c-4a2b-9614-dfe6fa6d04ca admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.306892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.307445 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.307727 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.307999 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.309297 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.314542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.324714 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1200/2426] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:22.326412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.336670 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c92c1a-4919-4106-a4c4-d64e41ed0dc4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.341339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adc3f4-dabb-4065-91bf-d9482f6e5504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.341938 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adc3f4-dabb-4065-91bf-d9482f6e5504 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.342292 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adc3f4-dabb-4065-91bf-d9482f6e5504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.342565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adc3f4-dabb-4065-91bf-d9482f6e5504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.343352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adc3f4-dabb-4065-91bf-d9482f6e5504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.345207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adc3f4-dabb-4065-91bf-d9482f6e5504 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.355969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1227/2427] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:22.360088 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.370355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266404da-a364-4aa8-b201-a04cc1836724 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.375829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.376522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.376874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.377218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] PATH_INFO: `/v3/projects/8c9b33fa4f104fe6994edae9afed3d0e/users/e2653638822145a391c7456c5089e757/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.393538 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9b33fa4f104fe6994edae9afed3d0e, user_id=e2653638822145a391c7456c5089e757, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.396322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.399630 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:22.475974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1201/2428] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:22 2022] PUT /identity/v3/projects/8c9b33fa4f104fe6994edae9afed3d0e/users/e2653638822145a391c7456c5089e757/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:22.488640 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.488956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.489230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.517999 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] MFA Rules not processed for user `e2653638822145a391c7456c5089e757`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:22.519229 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:22.585301 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1228/2429] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:22.589817 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.651052 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ba6af-373c-4edd-b4ca-f72de86606b8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.655680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.656284 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.656590 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.656863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.657488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.659655 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.764993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1202/2430] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:22 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:22.769017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.781113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793245-ea9f-4da4-a54f-42008d591b3c None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.790339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:22.838319 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.838947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.839230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.839532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.840745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.842763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.907930 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1229/2431] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:22 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:22.912967 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.921328 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.922968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:22.923556 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed31fd-829a-4bf7-8aa2-8fb32753ac32 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.928328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.928961 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.929247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.929525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.930194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.931802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.935213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3530e-58d9-4a5c-9f4e-9b505548b7b6 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.939736 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.940352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.940704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.940979 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] PATH_INFO: `/v3/users/178f192a30d544089f4e0fc2102465bb` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.942094 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=178f192a30d544089f4e0fc2102465bb)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.943060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1203/2432] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:22.947136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:22.947303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:22.956979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830c797-5644-4cd8-9afa-590cff5ecf7b admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:22.961731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:22.962360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:22.962639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:22.962906 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] PATH_INFO: `/v3/projects/2b99ed8ef35b4b6aa3963b327c818b05/users/b94f154ebab246c2bf4d923eca34e067/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:22.978232 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b99ed8ef35b4b6aa3963b327c818b05, user_id=b94f154ebab246c2bf4d923eca34e067, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:22.981837 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:23.080826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1204/2433] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:22 2022] PUT /identity/v3/projects/2b99ed8ef35b4b6aa3963b327c818b05/users/b94f154ebab246c2bf4d923eca34e067/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:23.084580 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:23.146264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c7840-4534-4b6a-a20c-aac66b8a3ad7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:23.151121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:23.151712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.152038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.152277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.152969 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:23.154625 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:23.164867 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1205/2434] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:23.169368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:23.169759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '178f192a30d544089f4e0fc2102465bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.177649 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '178f192a30d544089f4e0fc2102465bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.178548 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642493c5-3ad4-4cd1-8c8f-4f648167c29e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:23.184046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26b91-627a-43d4-96bd-366032d62579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:23.184701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26b91-627a-43d4-96bd-366032d62579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.184984 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26b91-627a-43d4-96bd-366032d62579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.185252 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26b91-627a-43d4-96bd-366032d62579 admin admin] PATH_INFO: `/v3/projects/2b99ed8ef35b4b6aa3963b327c818b05/users/b94f154ebab246c2bf4d923eca34e067/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.187858 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da26b91-627a-43d4-96bd-366032d62579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b99ed8ef35b4b6aa3963b327c818b05, user_id=b94f154ebab246c2bf4d923eca34e067, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:23.190535 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da26b91-627a-43d4-96bd-366032d62579 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:23.190706 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '178f192a30d544089f4e0fc2102465bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.191408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '178f192a30d544089f4e0fc2102465bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.201310 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1206/2435] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:23 2022] PUT /identity/v3/projects/2b99ed8ef35b4b6aa3963b327c818b05/users/b94f154ebab246c2bf4d923eca34e067/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:23.211461 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.211736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.212018 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.239775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] MFA Rules not processed for user `b94f154ebab246c2bf4d923eca34e067`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:23.241074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:23.258277 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:23.286603 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-43a92737-2156-4270-ace5-304ddb08ee25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '178f192a30d544089f4e0fc2102465bb'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.294408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1230/2436] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:22 2022] DELETE /identity/v3/users/178f192a30d544089f4e0fc2102465bb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:23.298825 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.299113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.299397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.316366 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1207/2437] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:23.324633 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:23.325084 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:23.326322 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:23.326442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:23.383353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a33de0-6119-4dda-a4f1-4293d9652549 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:23.387397 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1231/2438] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:23.397546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:23.398875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:23.420057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:23.436692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37989036-57fd-40ab-a70d-dd47f62b4ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:23.437390 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989036-57fd-40ab-a70d-dd47f62b4ebd service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.438456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989036-57fd-40ab-a70d-dd47f62b4ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.438456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37989036-57fd-40ab-a70d-dd47f62b4ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.462906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb69f82-b760-49e1-bedb-16be1c2a4da8 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:23.466665 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:23.467288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.467681 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.468183 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.477662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:23.479083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:23.489468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1232/2439] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:15:23.508065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37989036-57fd-40ab-a70d-dd47f62b4ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:23.508065 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37989036-57fd-40ab-a70d-dd47f62b4ebd service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:23.517457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1208/2440] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:15:23.548016 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:23.554283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:23.565405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59898cf-f965-4ab5-8726-17665cb78762 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:23.570381 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:23.571013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.571288 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.571561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] PATH_INFO: `/v3/users/e2653638822145a391c7456c5089e757` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.573418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2653638822145a391c7456c5089e757)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:23.574861 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:23.775026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2653638822145a391c7456c5089e757'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.786122 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2653638822145a391c7456c5089e757'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.800099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2653638822145a391c7456c5089e757'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.800927 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2653638822145a391c7456c5089e757'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.872481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2653638822145a391c7456c5089e757'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:23.881925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1233/2441] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:23 2022] DELETE /identity/v3/users/e2653638822145a391c7456c5089e757 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:23.883502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:23.883998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:23.884220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:23.903993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:23.905256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:23.918827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=100 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:23.965388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1209/2442] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:23.975185 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:23.976615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:24.011150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:24.011150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:24.022177 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949e326-3ccb-4675-b832-b4e72590a233 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:24.027362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:24.028653 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:24.028924 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:24.029203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] PATH_INFO: `/v3/projects/054ae5b809974ca7971578a830f9f2a4` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:24.030325 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054ae5b809974ca7971578a830f9f2a4)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:24.033084 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:24.037724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd225a4a-c8dd-4f32-bedf-e502f237dd50 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:24.042211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:24.042818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:24.043150 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:24.043431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:24.053236 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:24.054976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:24.065015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1234/2443] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:24.145082 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054ae5b809974ca7971578a830f9f2a4', 'request_id': 'req-f5c13520-d059-4d73-a006-82f3595ba046'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.151403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054ae5b809974ca7971578a830f9f2a4', 'request_id': 'req-f5c13520-d059-4d73-a006-82f3595ba046'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.158712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054ae5b809974ca7971578a830f9f2a4', 'request_id': 'req-f5c13520-d059-4d73-a006-82f3595ba046'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.231728 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] The token cache is being invalidate because project 054ae5b809974ca7971578a830f9f2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:24.232020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.232719 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.234233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1210/2444] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:24 2022] DELETE /identity/v3/projects/054ae5b809974ca7971578a830f9f2a4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:24.238410 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:24.248644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74be30-95ab-4ae0-9a02-c3209c40e46b service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:24.282626 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:24.310068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:24.310778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:24.311059 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:24.311337 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] PATH_INFO: `/v3/users/3d536894c75048e0b617dd3cb93f38f4` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:24.312524 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d536894c75048e0b617dd3cb93f38f4)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:24.314446 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:24.482688 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:24.484225 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:24.499110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c13520-d059-4d73-a006-82f3595ba046 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:24.505891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:24.506594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:24.506877 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:24.507279 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] PATH_INFO: `/v3/projects/8c9b33fa4f104fe6994edae9afed3d0e` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:24.512656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d536894c75048e0b617dd3cb93f38f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.513299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9b33fa4f104fe6994edae9afed3d0e)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:24.513299 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:24.517477 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d536894c75048e0b617dd3cb93f38f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.529976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d536894c75048e0b617dd3cb93f38f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.530719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d536894c75048e0b617dd3cb93f38f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.615442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d536894c75048e0b617dd3cb93f38f4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.622431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1235/2445] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:24 2022] DELETE /identity/v3/users/3d536894c75048e0b617dd3cb93f38f4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:24.679692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9b33fa4f104fe6994edae9afed3d0e', 'request_id': 'req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.685916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9b33fa4f104fe6994edae9afed3d0e', 'request_id': 'req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.703857 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9b33fa4f104fe6994edae9afed3d0e', 'request_id': 'req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.790179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] The token cache is being invalidate because project 8c9b33fa4f104fe6994edae9afed3d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:24.790475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.791107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:24.792740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1211/2446] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:24 2022] DELETE /identity/v3/projects/8c9b33fa4f104fe6994edae9afed3d0e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:24.797225 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:24.798684 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:24.884801 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6cb0f-5f92-4233-8e6e-dd130ff728e7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:24.970975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:24.976294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:24.976294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:24.976294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] PATH_INFO: `/v3/users/b94f154ebab246c2bf4d923eca34e067` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:24.976294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94f154ebab246c2bf4d923eca34e067)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:24.976294 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:24.977361 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:25.103173 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.104684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:25.118500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed23ac-6cb8-4598-b2f0-2fe64ce84102 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.123644 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.124287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.124606 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.125687 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] PATH_INFO: `/v3/projects/9f6ba372237a4520903e38c8fb019be2` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.128889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6ba372237a4520903e38c8fb019be2)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.128889 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.153443 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:25.239182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94f154ebab246c2bf4d923eca34e067'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.243427 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6ba372237a4520903e38c8fb019be2', 'request_id': 'req-49f8625e-d829-4c11-9688-3ef87ebda408'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.247081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94f154ebab246c2bf4d923eca34e067'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.249667 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6ba372237a4520903e38c8fb019be2', 'request_id': 'req-49f8625e-d829-4c11-9688-3ef87ebda408'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.256657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6ba372237a4520903e38c8fb019be2', 'request_id': 'req-49f8625e-d829-4c11-9688-3ef87ebda408'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.260310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94f154ebab246c2bf4d923eca34e067'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.261128 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94f154ebab246c2bf4d923eca34e067'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.335872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] The token cache is being invalidate because project 9f6ba372237a4520903e38c8fb019be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:25.336184 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.336814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-49f8625e-d829-4c11-9688-3ef87ebda408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.338318 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1212/2447] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:25 2022] DELETE /identity/v3/projects/9f6ba372237a4520903e38c8fb019be2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:25.343680 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.343963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.344231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.364331 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:25.365694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:25.415715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-742bc24a-3c05-4e46-afac-d04ccfe43ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94f154ebab246c2bf4d923eca34e067'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.423802 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1236/2448] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:24 2022] DELETE /identity/v3/users/b94f154ebab246c2bf4d923eca34e067 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:25.428775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1213/2449] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:25.436484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.437006 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.437544 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.461325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:25.462896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:25.531479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1237/2450] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:25.536143 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.545898 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1260e2-cae2-417e-8a69-2a95d40775fe None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.550465 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.551188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.551478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.551752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.552418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:25.552740 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.554340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.567784 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1214/2451] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:25.582054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.592928 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e994baf-54db-41ea-bc6a-f53a23811a84 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.597828 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.598648 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.598739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.598960 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.599708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.601669 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.721120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1238/2452] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:25 2022] POST /identity/v3/projects => generated 397 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:25.722249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.732467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34969fd2-e69c-4855-8269-9ca956c38649 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.791591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.792201 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.792516 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.792790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.793457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.795388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.831991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.833783 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:25.847632 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e1853-9c8f-497e-85bf-a8e0abc081f7 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.852656 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.853977 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.854291 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.854563 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] PATH_INFO: `/v3/projects/2b99ed8ef35b4b6aa3963b327c818b05` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.855729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b99ed8ef35b4b6aa3963b327c818b05)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.857871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.894131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1215/2453] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:25 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:25.898176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.907893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176d369-1eb0-4e6d-a979-98c85be044d7 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.912937 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.913521 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.913802 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.914159 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.914797 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.916377 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.926987 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1216/2454] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:25.936899 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.946320 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae28cf-70c2-4444-960b-2b945665823a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:25.951551 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:25.952111 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:25.952415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:25.952691 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:25.953315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:25.954868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:25.966346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1217/2455] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:25.971421 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b99ed8ef35b4b6aa3963b327c818b05', 'request_id': 'req-91576672-8a90-4eab-87c4-d98a6503c0ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.971834 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:25.974154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:25.977910 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:25.979026 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b99ed8ef35b4b6aa3963b327c818b05', 'request_id': 'req-91576672-8a90-4eab-87c4-d98a6503c0ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:25.981578 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d84a09-e18e-4e38-946a-2ea4c95805a6 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.036894 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94158e3-d3dc-4260-8db8-e63a88f32ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.037586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94158e3-d3dc-4260-8db8-e63a88f32ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.037913 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94158e3-d3dc-4260-8db8-e63a88f32ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.038135 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94158e3-d3dc-4260-8db8-e63a88f32ce1 admin admin] PATH_INFO: `/v3/projects/8547057febb54f23bd71ed28872d30fe/users/14415957e16f4dacb855123dcf913fe0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.052179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94158e3-d3dc-4260-8db8-e63a88f32ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8547057febb54f23bd71ed28872d30fe, user_id=14415957e16f4dacb855123dcf913fe0, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.054872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94158e3-d3dc-4260-8db8-e63a88f32ce1 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.056141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b99ed8ef35b4b6aa3963b327c818b05', 'request_id': 'req-91576672-8a90-4eab-87c4-d98a6503c0ac'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:26.068163 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] The token cache is being invalidate because project 2b99ed8ef35b4b6aa3963b327c818b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:26.068553 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:26.069226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-91576672-8a90-4eab-87c4-d98a6503c0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:26.070795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1239/2456] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:25 2022] DELETE /identity/v3/projects/2b99ed8ef35b4b6aa3963b327c818b05 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:26.075967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88611f7-af6b-46b8-820a-91e1744df68b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.076254 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88611f7-af6b-46b8-820a-91e1744df68b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.076565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88611f7-af6b-46b8-820a-91e1744df68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.095651 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-d88611f7-af6b-46b8-820a-91e1744df68b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:26.096937 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-d88611f7-af6b-46b8-820a-91e1744df68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:26.105001 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1240/2457] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:26.112412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105520-79c8-44f3-bccb-896580482f31 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.112698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105520-79c8-44f3-bccb-896580482f31 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.112975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105520-79c8-44f3-bccb-896580482f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.132770 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-12105520-79c8-44f3-bccb-896580482f31 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:26.133946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-12105520-79c8-44f3-bccb-896580482f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:26.142554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1241/2458] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:26.146403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12105520-79c8-44f3-bccb-896580482f31 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.155310 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12105520-79c8-44f3-bccb-896580482f31 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.160209 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.160836 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.161119 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.161394 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.162035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:26.162339 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.163990 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.164888 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1218/2459] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:25 2022] PUT /identity/v3/projects/8547057febb54f23bd71ed28872d30fe/users/14415957e16f4dacb855123dcf913fe0/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:26.176983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1242/2460] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 14 03:15:26.181051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.181537 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.181822 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.182096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.191893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ea4dc-1d9f-4c14-8cdb-f5fde1b47d49 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.210436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] MFA Rules not processed for user `14415957e16f4dacb855123dcf913fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:26.211647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:26.249474 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.250082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.250439 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.250643 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.251273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.253196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.277267 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1219/2461] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:26.288960 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.290261 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:26.345672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf74195-74b0-445f-98ab-ecfcf1ee7a7b None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.349326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.349922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.350202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.350475 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.359197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.360605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.372341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1243/2462] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:26.372570 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1220/2463] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:15:26.380351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.442616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d73ba-4f1c-4b4e-8a4a-a1dbe2f6e339 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.451041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.451041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.451041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.451041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.451428 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.453002 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.570419 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1244/2464] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:26.576432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.587503 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf418c6-30c6-4745-9315-69aa1a0ba252 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.593223 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.593861 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.594127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.594403 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.595047 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.596715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.609108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1221/2465] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:26.612778 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.623106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c890-8911-4ca9-aabd-9d1de7be6820 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.627967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b975b-419c-4937-9f8b-8b05fc4198d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.628610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b975b-419c-4937-9f8b-8b05fc4198d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.628908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b975b-419c-4937-9f8b-8b05fc4198d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.629174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b975b-419c-4937-9f8b-8b05fc4198d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.629834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b975b-419c-4937-9f8b-8b05fc4198d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.631444 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b975b-419c-4937-9f8b-8b05fc4198d8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.642821 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1245/2466] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:26.647093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.658136 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd11af5-5156-4ced-83ec-90afed629fbe admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.663155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.663814 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.664096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.664373 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] PATH_INFO: `/v3/projects/d728f257f4fa4c2c9283130b59920563/users/2b88ee1994d14452adb877a7bec76033/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.667548 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:26.681243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d728f257f4fa4c2c9283130b59920563, user_id=2b88ee1994d14452adb877a7bec76033, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.683921 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:26.773205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1222/2467] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:26 2022] PUT /identity/v3/projects/d728f257f4fa4c2c9283130b59920563/users/2b88ee1994d14452adb877a7bec76033/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:26.785121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.785408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.785709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.814868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] MFA Rules not processed for user `2b88ee1994d14452adb877a7bec76033`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:26.816083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:26.821458 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:26.881438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1246/2468] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:26.886027 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:26.951381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dfbf-44f6-41e7-a765-ae89b4a9a824 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:26.956359 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:26.956993 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:26.957282 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:26.957552 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:26.958221 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:26.960274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.086774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1223/2469] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:26 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:27.087985 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:27.099549 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d42d04-8861-4def-a7f7-c6af457ddf1a None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:27.172991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:27.176588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.176588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.176588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] PATH_INFO: `/v3/users` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.176588 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:27.177061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.259246 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1247/2470] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:27 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:27.263793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:27.280316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4a12f-e05a-4ec3-9111-5f1f00eee815 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:27.280316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:27.281209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.281209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.281209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.281783 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:27.283409 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.294396 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1224/2471] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:27.298432 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:27.310213 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060c12-6648-4d93-9a2d-415609b14750 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:27.314934 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:27.315593 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.315873 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.316147 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] PATH_INFO: `/v3/projects/e262d3de430a4b74a5f244c943e70d91/users/b2d021ce224249a18689f32c5b4dc818/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.339160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e262d3de430a4b74a5f244c943e70d91, user_id=b2d021ce224249a18689f32c5b4dc818, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:27.342554 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.451607 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1248/2472] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:27 2022] PUT /identity/v3/projects/e262d3de430a4b74a5f244c943e70d91/users/b2d021ce224249a18689f32c5b4dc818/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:27.458048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:27.466504 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d5da5-9cc3-47ba-b0a1-2585219d05b9 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:27.533774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed884-94cc-4eaf-8522-39a4f15c421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:27.534389 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed884-94cc-4eaf-8522-39a4f15c421e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.534931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed884-94cc-4eaf-8522-39a4f15c421e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.535209 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed884-94cc-4eaf-8522-39a4f15c421e admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.535854 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed884-94cc-4eaf-8522-39a4f15c421e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:27.537562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed884-94cc-4eaf-8522-39a4f15c421e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.547952 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1225/2473] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:27.552363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:27.563473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70175249-6976-4ad4-8fd1-4af6aa5f6a70 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:27.568430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:27.569179 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.569461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.569763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] PATH_INFO: `/v3/projects/e262d3de430a4b74a5f244c943e70d91/users/b2d021ce224249a18689f32c5b4dc818/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.571763 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e262d3de430a4b74a5f244c943e70d91, user_id=b2d021ce224249a18689f32c5b4dc818, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:27.574561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.589868 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1249/2474] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:27 2022] PUT /identity/v3/projects/e262d3de430a4b74a5f244c943e70d91/users/b2d021ce224249a18689f32c5b4dc818/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:27.600294 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601792-e751-434b-b4ee-e2ea18b22bc2 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.600617 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601792-e751-434b-b4ee-e2ea18b22bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.600897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb601792-e751-434b-b4ee-e2ea18b22bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.632168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-bb601792-e751-434b-b4ee-e2ea18b22bc2 None None] MFA Rules not processed for user `b2d021ce224249a18689f32c5b4dc818`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:27.633329 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-bb601792-e751-434b-b4ee-e2ea18b22bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:27.678042 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:27.703295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1226/2475] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:27.715709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:27.717585 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:27.784182 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e43707-b646-474c-aafe-362debdaf6e2 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:27.788980 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:27.789582 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:27.789860 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:27.790136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:27.803072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:27.854052 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:27.855489 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:27.865139 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1250/2476] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:29.195743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:29.196243 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:29.196348 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:29.215829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:29.217048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:29.271269 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1227/2477] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:15:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:29.441035 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:29.442469 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:29.511600 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fce6b-c4e2-40d1-a973-c69cae794c43 service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:29.516559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2085c-edbf-463b-917a-d137734907d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:29.517184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2085c-edbf-463b-917a-d137734907d1 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:29.517443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2085c-edbf-463b-917a-d137734907d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:29.517715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2085c-edbf-463b-917a-d137734907d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:29.525667 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2085c-edbf-463b-917a-d137734907d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:29.527234 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2085c-edbf-463b-917a-d137734907d1 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:29.535507 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1251/2478] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:15:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:15:29.714447 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:29.724476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1e8a2-072a-47db-b3ed-cd4c30ac9ffe None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:29.727978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:29.728642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:29.728922 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:29.729191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:29.738946 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:29.740367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:29.749640 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1228/2479] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:30.362834 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106345-4864-4d20-861c-4b608b9cce0d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:30.363121 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106345-4864-4d20-861c-4b608b9cce0d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:30.363400 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106345-4864-4d20-861c-4b608b9cce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:30.383500 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-ae106345-4864-4d20-861c-4b608b9cce0d None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:30.384772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-ae106345-4864-4d20-861c-4b608b9cce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:30.392683 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1252/2480] 10.222.0.13 () {58 vars in 967 bytes} [Fri Oct 14 03:15:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:30.405191 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:30.417003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520dcf-c725-4b4e-a296-be16b37d0974 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:30.422790 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:30.424939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:30.424939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:30.424939 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:30.432676 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:30.434295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:30.443752 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1229/2481] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:15:31.140221 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b355d-2c97-4479-9e59-e8221132f5b4 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:31.140830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b355d-2c97-4479-9e59-e8221132f5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:31.140830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b355d-2c97-4479-9e59-e8221132f5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:31.160629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-053b355d-2c97-4479-9e59-e8221132f5b4 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:31.161851 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-053b355d-2c97-4479-9e59-e8221132f5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:31.169072 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1253/2482] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:31.182897 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:31.193883 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233c27-c31d-4843-b20c-d990fc2bb4f9 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:31.198974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:31.199569 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:31.199847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:31.200118 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:31.208242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:31.209932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:31.227701 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1230/2483] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:15:31.945387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:31.945738 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:31.946018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:31.965596 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:31.966826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:31.973899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1254/2484] 10.222.0.13 () {58 vars in 967 bytes} [Fri Oct 14 03:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:31.986247 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:31.996690 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb4a09-5726-49a2-a9f9-31564c83bee2 service swift] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:32.002257 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cea02-f15b-4589-8837-2de9ba122192 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:32.002853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cea02-f15b-4589-8837-2de9ba122192 service swift] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:32.003128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cea02-f15b-4589-8837-2de9ba122192 service swift] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:32.003435 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cea02-f15b-4589-8837-2de9ba122192 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:32.011353 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cea02-f15b-4589-8837-2de9ba122192 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:32.013586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cea02-f15b-4589-8837-2de9ba122192 service swift] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:32.021618 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1231/2485] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:15:32.460905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:32.466454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:32.546628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef7da4-77c6-4df7-8d67-a8f14da0f20b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:32.551551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:32.554306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:32.554306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:32.554306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] PATH_INFO: `/v3/users/14415957e16f4dacb855123dcf913fe0` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:32.554306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14415957e16f4dacb855123dcf913fe0)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:32.556051 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:32.677885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:32.745543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14415957e16f4dacb855123dcf913fe0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:32.752939 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14415957e16f4dacb855123dcf913fe0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:32.765989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14415957e16f4dacb855123dcf913fe0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:32.768709 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14415957e16f4dacb855123dcf913fe0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:32.848531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14415957e16f4dacb855123dcf913fe0'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:32.856173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1255/2486] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:32 2022] DELETE /identity/v3/users/14415957e16f4dacb855123dcf913fe0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:32.866006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:32.866296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:32.866576 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:32.889978 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:32.891383 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:32.960253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1232/2487] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:32.970606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:32.972039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:33.031971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5aa32-f79d-4e2d-8ead-29d7703e5225 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:33.036144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:33.036808 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:33.037089 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:33.037369 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:33.046739 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:33.048170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:33.058983 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1256/2488] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:33.481488 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:33.483063 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:33.496829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59049592-c6eb-4334-9b06-df292ad79cb6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:33.502240 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:33.506356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:33.506356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:33.506356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] PATH_INFO: `/v3/projects/8547057febb54f23bd71ed28872d30fe` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:33.506356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8547057febb54f23bd71ed28872d30fe)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:33.506753 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:33.652479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:33.666328 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8547057febb54f23bd71ed28872d30fe', 'request_id': 'req-8d1319bb-76f2-46b6-87ab-10cc1750e606'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:33.671849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8547057febb54f23bd71ed28872d30fe', 'request_id': 'req-8d1319bb-76f2-46b6-87ab-10cc1750e606'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:33.678197 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8547057febb54f23bd71ed28872d30fe', 'request_id': 'req-8d1319bb-76f2-46b6-87ab-10cc1750e606'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:33.759788 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] The token cache is being invalidate because project 8547057febb54f23bd71ed28872d30fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:33.760127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:33.761362 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8d1319bb-76f2-46b6-87ab-10cc1750e606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:33.764850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1233/2489] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:33 2022] DELETE /identity/v3/projects/8547057febb54f23bd71ed28872d30fe => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:34.297113 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:34.298530 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:34.311171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a951-029a-4352-93bb-007b67fe8419 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:34.368599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:34.369231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:34.369519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:34.369788 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] PATH_INFO: `/v3/users/2b88ee1994d14452adb877a7bec76033` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:34.370891 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b88ee1994d14452adb877a7bec76033)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:34.373131 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:34.551134 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b88ee1994d14452adb877a7bec76033'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.552479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:34.558911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b88ee1994d14452adb877a7bec76033'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.570580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b88ee1994d14452adb877a7bec76033'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.571241 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b88ee1994d14452adb877a7bec76033'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.639804 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b88ee1994d14452adb877a7bec76033'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.645953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1257/2490] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:34 2022] DELETE /identity/v3/users/2b88ee1994d14452adb877a7bec76033 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:34.650549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:34.651049 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:34.651164 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:34.671185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:34.672416 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:34.730608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1234/2491] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:34.740468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:34.741878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:34.764293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:34.765682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:34.777393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536fe39-b7e3-4a49-b788-41c52a9d8a7d None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:34.782610 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:34.783162 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:34.783442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:34.783717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] PATH_INFO: `/v3/users/20ecd6112f824d4eafb2f51518b5e873` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:34.784863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ecd6112f824d4eafb2f51518b5e873)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:34.787020 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:34.802717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37e3f5-b14d-4354-a63d-ccf1ef55909a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:34.806430 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52171865-e152-4950-bf28-2f48728cd81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:34.807037 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171865-e152-4950-bf28-2f48728cd81e service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:34.807324 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171865-e152-4950-bf28-2f48728cd81e service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:34.807598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52171865-e152-4950-bf28-2f48728cd81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:34.816862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52171865-e152-4950-bf28-2f48728cd81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:34.822338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52171865-e152-4950-bf28-2f48728cd81e service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:34.828110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1258/2492] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:34.963053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ecd6112f824d4eafb2f51518b5e873'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.970093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ecd6112f824d4eafb2f51518b5e873'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:34.970775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ecd6112f824d4eafb2f51518b5e873'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.054211 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ecd6112f824d4eafb2f51518b5e873'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.068827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ecd6112f824d4eafb2f51518b5e873'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.075582 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1235/2493] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:34 2022] DELETE /identity/v3/users/20ecd6112f824d4eafb2f51518b5e873 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:35.080191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:35.080579 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:35.080925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:35.101359 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:35.102969 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:35.164174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1259/2494] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:35.173933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:35.175341 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:35.207315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:35.221496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:35.222917 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:35.235837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6247f1-5606-432f-b9a0-b99cc7f36df1 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:35.239803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fd5af-4197-4a27-aa6b-46715b8bdc2e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:35.240905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:35.252644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:35.252644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:35.252644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] PATH_INFO: `/v3/projects/d728f257f4fa4c2c9283130b59920563` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:35.252644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d728f257f4fa4c2c9283130b59920563)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:35.253457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:35.253457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:35.253457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:35.253457 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:35.254211 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:35.254892 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:35.256911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:35.266769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1236/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:35.377386 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd728f257f4fa4c2c9283130b59920563', 'request_id': 'req-533d8ca9-7021-45d4-8c60-7b10e3d8b345'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.383698 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd728f257f4fa4c2c9283130b59920563', 'request_id': 'req-533d8ca9-7021-45d4-8c60-7b10e3d8b345'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.479924 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd728f257f4fa4c2c9283130b59920563', 'request_id': 'req-533d8ca9-7021-45d4-8c60-7b10e3d8b345'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.482784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:35.491674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] The token cache is being invalidate because project d728f257f4fa4c2c9283130b59920563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:35.491967 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.492629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.494170 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1260/2496] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:35 2022] DELETE /identity/v3/projects/d728f257f4fa4c2c9283130b59920563 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:35.498847 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:35.508729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f48a82-13b0-430f-a01c-fd89cf8b778e service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:35.510529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:35.511914 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:35.569607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:35.570195 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:35.570480 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:35.570756 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] PATH_INFO: `/v3/users/b2d021ce224249a18689f32c5b4dc818` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:35.571963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d021ce224249a18689f32c5b4dc818)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:35.573911 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:35.584495 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d8ca9-7021-45d4-8c60-7b10e3d8b345 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:35.590222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:35.590854 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:35.591132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:35.591403 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] PATH_INFO: `/v3/projects/6117dd60941f4804899175ecf89aefa4` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:35.593181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6117dd60941f4804899175ecf89aefa4)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:35.595142 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:35.762641 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d021ce224249a18689f32c5b4dc818'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.763184 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6117dd60941f4804899175ecf89aefa4', 'request_id': 'req-c4623e5e-78d3-45d9-aede-53d2d117050e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.769174 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6117dd60941f4804899175ecf89aefa4', 'request_id': 'req-c4623e5e-78d3-45d9-aede-53d2d117050e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.769568 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d021ce224249a18689f32c5b4dc818'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.770275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d021ce224249a18689f32c5b4dc818'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.825571 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6117dd60941f4804899175ecf89aefa4', 'request_id': 'req-c4623e5e-78d3-45d9-aede-53d2d117050e'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.836795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] The token cache is being invalidate because project 6117dd60941f4804899175ecf89aefa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:35.837140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.838559 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.840066 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1261/2497] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:35 2022] DELETE /identity/v3/projects/6117dd60941f4804899175ecf89aefa4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:35.911862 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d021ce224249a18689f32c5b4dc818'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.926801 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-230f84e4-663e-4a2a-9fda-523ab890dff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d021ce224249a18689f32c5b4dc818'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:35.933346 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1237/2498] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:35 2022] DELETE /identity/v3/users/b2d021ce224249a18689f32c5b4dc818 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:36.338378 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:36.342497 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:36.405367 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4623e5e-78d3-45d9-aede-53d2d117050e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:36.430897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:36.461449 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:36.462081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:36.462364 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:36.462641 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] PATH_INFO: `/v3/projects/e262d3de430a4b74a5f244c943e70d91` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:36.463756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e262d3de430a4b74a5f244c943e70d91)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:36.465919 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:36.581463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e262d3de430a4b74a5f244c943e70d91', 'request_id': 'req-1ee2e83d-1669-4da1-a413-1851cedf0ef2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:36.587862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e262d3de430a4b74a5f244c943e70d91', 'request_id': 'req-1ee2e83d-1669-4da1-a413-1851cedf0ef2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:36.674786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e262d3de430a4b74a5f244c943e70d91', 'request_id': 'req-1ee2e83d-1669-4da1-a413-1851cedf0ef2'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:36.686774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] The token cache is being invalidate because project e262d3de430a4b74a5f244c943e70d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:36.687071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:36.687732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-1ee2e83d-1669-4da1-a413-1851cedf0ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:36.689273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1262/2499] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:36 2022] DELETE /identity/v3/projects/e262d3de430a4b74a5f244c943e70d91 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:36.694289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:36.694613 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:36.694893 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:36.715015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:36.716226 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:36.760326 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:36.773916 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1238/2500] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:36.781944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:36.782258 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:36.782532 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:36.802777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:36.803984 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:36.812320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1263/2501] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:36.816470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:36.825743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc6caa-4a7c-4bea-a31b-f7c7958ed816 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:36.830729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:36.831316 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:36.831594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:36.831868 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:36.832554 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:36.832853 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:36.835486 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:36.845807 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1239/2502] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:36.850245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:36.860551 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a6bd-00a5-4562-bfc9-7eac06eef3fa None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:36.865539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358451-0320-48db-b966-195cf3474575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:36.866141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358451-0320-48db-b966-195cf3474575 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:36.866426 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358451-0320-48db-b966-195cf3474575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:36.866731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25358451-0320-48db-b966-195cf3474575 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:36.867427 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25358451-0320-48db-b966-195cf3474575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:36.869363 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25358451-0320-48db-b966-195cf3474575 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:36.984952 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1264/2503] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:36 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 14 03:15:36.989034 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:36.999692 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae9df-b6fd-4b94-a8e8-241610992111 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.055222 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.055849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.056134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.056444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.057078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.059011 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.160458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1240/2504] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:36 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:37.164768 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358451-0320-48db-b966-195cf3474575 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.175637 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25358451-0320-48db-b966-195cf3474575 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.180231 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.180855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.181141 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.181412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.182080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.183705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.193453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1265/2505] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 14 03:15:37.197273 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.207070 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cfdd0-591f-4f2f-9943-862f3a3f33e3 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.211661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec562a-129b-4c94-a44d-0b893d7294e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.212251 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec562a-129b-4c94-a44d-0b893d7294e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.212575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec562a-129b-4c94-a44d-0b893d7294e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.212851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec562a-129b-4c94-a44d-0b893d7294e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.213494 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec562a-129b-4c94-a44d-0b893d7294e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.215074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec562a-129b-4c94-a44d-0b893d7294e8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.225947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1241/2506] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:37.229776 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.240257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a35b-df59-4efa-996b-21bd70aa9317 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.244759 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.245392 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.245674 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.245950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] PATH_INFO: `/v3/projects/96d9c41dee9645888c73079fff70930e/users/25665ff2a9074b7094b8339b3af2f573/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.260138 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d9c41dee9645888c73079fff70930e, user_id=25665ff2a9074b7094b8339b3af2f573, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.262809 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.325123 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1266/2507] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:37 2022] PUT /identity/v3/projects/96d9c41dee9645888c73079fff70930e/users/25665ff2a9074b7094b8339b3af2f573/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:37.336208 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.336529 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.336808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.364771 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] MFA Rules not processed for user `25665ff2a9074b7094b8339b3af2f573`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:37.365980 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:37.432006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1242/2508] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:37.436796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.493257 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:37.498189 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbb1ce-9750-4fa3-a9b2-c51bd5c3010f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.502796 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.503814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.503814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.504015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.504564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.506443 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.636863 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1267/2509] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:37 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:37.638061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.650179 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74b1d5-39ef-453d-a6a4-b0a888a303fc None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.704562 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:37.719176 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.719789 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.720072 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.720344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.721006 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.723091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.814642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1243/2510] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:37 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:37.818480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.829255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2e7e9-15c3-4f27-9a51-49375089df78 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.833947 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.834537 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.834817 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.835090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.835726 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.837341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.847598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1268/2511] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:37.851456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.861456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf3a3d-15ba-4e8d-85e7-9640613d3f3c admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.866155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6d7e5-109e-49da-a64f-efa717fb1cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.866762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d7e5-109e-49da-a64f-efa717fb1cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.867045 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d7e5-109e-49da-a64f-efa717fb1cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.867322 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6d7e5-109e-49da-a64f-efa717fb1cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.867972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d7e5-109e-49da-a64f-efa717fb1cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.869626 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6d7e5-109e-49da-a64f-efa717fb1cf8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:37.880248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1244/2512] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:37.884274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:37.895207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc505c43-4607-456e-b39d-49ef3f997df9 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:37.899837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:37.900514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:37.900791 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:37.901061 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] PATH_INFO: `/v3/projects/f5e9c4552bf9431a88b1a14f2b1dc454/users/89aba675f82444bd890af5e66c6cc6ee/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:37.915911 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e9c4552bf9431a88b1a14f2b1dc454, user_id=89aba675f82444bd890af5e66c6cc6ee, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:37.919560 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.011955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1269/2513] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:37 2022] PUT /identity/v3/projects/f5e9c4552bf9431a88b1a14f2b1dc454/users/89aba675f82444bd890af5e66c6cc6ee/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:38.022850 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.023137 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.023412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.050979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] MFA Rules not processed for user `89aba675f82444bd890af5e66c6cc6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:38.054460 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:38.118955 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1245/2514] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:38.123799 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.185374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0885663-44ef-43f1-9a10-70587d3ed292 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.190562 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.191171 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.191450 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.191732 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.192425 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.194388 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.299833 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1270/2515] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:38 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:38.304254 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.315678 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e635-0963-4e01-970b-8d33a4fbf06f None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.372467 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.373002 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.373285 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.374194 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.374824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.376767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.435218 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1246/2516] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:38 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:38.439942 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.450961 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bbac2-f5da-4558-9281-eebc8b561bb1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.455950 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.456590 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.456874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.457152 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.466274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.466274 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.470408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1271/2517] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:38.474615 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.485476 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6eeff-058a-4e2b-950c-6d115e892ffc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.490098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.490750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.491030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.491308 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] PATH_INFO: `/v3/projects/d752d085e080463998b5bafe5ab0e066/users/a7089862d35c47df91214ecc235b44c1/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.506450 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d752d085e080463998b5bafe5ab0e066, user_id=a7089862d35c47df91214ecc235b44c1, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.509145 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.595831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1247/2518] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:38 2022] PUT /identity/v3/projects/d752d085e080463998b5bafe5ab0e066/users/a7089862d35c47df91214ecc235b44c1/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:38.600146 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.610859 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b65b5b-92ec-434d-9729-2048bfdd9af4 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.666621 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce66351-2d99-41b4-bb8f-0862c886149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.667136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce66351-2d99-41b4-bb8f-0862c886149e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.667418 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce66351-2d99-41b4-bb8f-0862c886149e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.667721 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce66351-2d99-41b4-bb8f-0862c886149e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.668415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce66351-2d99-41b4-bb8f-0862c886149e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.670030 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce66351-2d99-41b4-bb8f-0862c886149e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.680815 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1272/2519] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:38.685172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.695642 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9373-fce9-441c-82b3-89df79aca9c8 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.700492 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.701144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.701463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.701736 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] PATH_INFO: `/v3/projects/d752d085e080463998b5bafe5ab0e066/users/a7089862d35c47df91214ecc235b44c1/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.703670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d752d085e080463998b5bafe5ab0e066, user_id=a7089862d35c47df91214ecc235b44c1, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.706368 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.717798 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1248/2520] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:38 2022] PUT /identity/v3/projects/d752d085e080463998b5bafe5ab0e066/users/a7089862d35c47df91214ecc235b44c1/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:38.729283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.729573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.729849 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.758436 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] MFA Rules not processed for user `a7089862d35c47df91214ecc235b44c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:38.759645 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:38.763539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:38.830840 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1273/2521] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:38.842003 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:38.844367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:38.854336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:38.901793 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0657e-92ab-4fe0-8263-0a107caa965a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:38.906046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:38.906647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:38.906925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:38.907198 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:38.916283 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:38.917805 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:38.927755 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1249/2522] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:39.072514 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:39.073940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:39.086401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ba578-fc53-4742-8ff6-af89c49a7052 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:39.090120 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f212de7-3c8f-4813-ae27-3397e1067921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:39.090715 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f212de7-3c8f-4813-ae27-3397e1067921 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:39.090991 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f212de7-3c8f-4813-ae27-3397e1067921 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:39.091260 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f212de7-3c8f-4813-ae27-3397e1067921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:39.149580 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f212de7-3c8f-4813-ae27-3397e1067921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:39.151090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f212de7-3c8f-4813-ae27-3397e1067921 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:39.160672 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1274/2523] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:43.201825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:43.264458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb94115-1421-48e2-8466-261761830df7 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:43.270303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:43.271415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:43.271415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:43.271594 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] PATH_INFO: `/v3/users/25665ff2a9074b7094b8339b3af2f573` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:43.272693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25665ff2a9074b7094b8339b3af2f573)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:43.274598 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:43.451388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25665ff2a9074b7094b8339b3af2f573'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:43.458775 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25665ff2a9074b7094b8339b3af2f573'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:43.459432 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25665ff2a9074b7094b8339b3af2f573'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:43.524032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25665ff2a9074b7094b8339b3af2f573'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:43.538016 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25665ff2a9074b7094b8339b3af2f573'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:43.544015 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1250/2524] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:43 2022] DELETE /identity/v3/users/25665ff2a9074b7094b8339b3af2f573 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:43.549155 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:43.549628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:43.549729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:43.569627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:43.570742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:43.627325 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1275/2525] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:15:43.637062 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:43.638442 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:43.671824 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:43.697367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f85d36-2e53-4888-bbec-07b62c212593 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:43.701278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:43.701891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:43.702216 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:43.702515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:43.712036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:43.718664 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:43.723107 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1251/2526] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:44.111949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:44.113480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:44.125731 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06522e9-81d0-4fcd-a1f9-98b03247f326 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:44.131087 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:44.131479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:44.131767 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:44.132071 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] PATH_INFO: `/v3/projects/96d9c41dee9645888c73079fff70930e` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:44.133393 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d9c41dee9645888c73079fff70930e)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:44.135433 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:44.226615 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:44.236962 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d9c41dee9645888c73079fff70930e', 'request_id': 'req-33068d5d-9c79-44d2-bcea-e26575deee07'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.243088 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d9c41dee9645888c73079fff70930e', 'request_id': 'req-33068d5d-9c79-44d2-bcea-e26575deee07'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.309733 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d9c41dee9645888c73079fff70930e', 'request_id': 'req-33068d5d-9c79-44d2-bcea-e26575deee07'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.320314 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] The token cache is being invalidate because project 96d9c41dee9645888c73079fff70930e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:44.320822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.321886 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.323405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1276/2527] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:44 2022] DELETE /identity/v3/projects/96d9c41dee9645888c73079fff70930e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:44.328089 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:44.337875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ccd29-579f-47f9-a715-71a983b17468 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:44.393087 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:44.393709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:44.393990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:44.394266 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] PATH_INFO: `/v3/users/89aba675f82444bd890af5e66c6cc6ee` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:44.395369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89aba675f82444bd890af5e66c6cc6ee)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:44.397339 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:44.732411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89aba675f82444bd890af5e66c6cc6ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.740514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89aba675f82444bd890af5e66c6cc6ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.742842 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89aba675f82444bd890af5e66c6cc6ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.833001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89aba675f82444bd890af5e66c6cc6ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.846505 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89aba675f82444bd890af5e66c6cc6ee'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:44.852550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1252/2528] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:44 2022] DELETE /identity/v3/users/89aba675f82444bd890af5e66c6cc6ee => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:45.400300 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:45.401885 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:45.415525 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33068d5d-9c79-44d2-bcea-e26575deee07 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:45.478951 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:45.479581 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:45.479862 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:45.480137 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] PATH_INFO: `/v3/projects/f5e9c4552bf9431a88b1a14f2b1dc454` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:45.481273 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e9c4552bf9431a88b1a14f2b1dc454)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:45.483172 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:45.596351 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e9c4552bf9431a88b1a14f2b1dc454', 'request_id': 'req-a069f328-d082-4076-931e-312a5c23418d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.602663 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e9c4552bf9431a88b1a14f2b1dc454', 'request_id': 'req-a069f328-d082-4076-931e-312a5c23418d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.643773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e9c4552bf9431a88b1a14f2b1dc454', 'request_id': 'req-a069f328-d082-4076-931e-312a5c23418d'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.655173 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] The token cache is being invalidate because project f5e9c4552bf9431a88b1a14f2b1dc454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:45.655522 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.656167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.657704 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1277/2529] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:45 2022] DELETE /identity/v3/projects/f5e9c4552bf9431a88b1a14f2b1dc454 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:45.661774 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:45.663555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:45.676767 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6bdaf-62cd-4e66-a709-58a9475789b0 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:45.722956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:45.732542 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:45.733170 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:45.733455 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:45.733731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] PATH_INFO: `/v3/users/a7089862d35c47df91214ecc235b44c1` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:45.735388 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7089862d35c47df91214ecc235b44c1)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:45.737358 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:45.898248 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7089862d35c47df91214ecc235b44c1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.905205 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7089862d35c47df91214ecc235b44c1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.905849 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7089862d35c47df91214ecc235b44c1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:45.995478 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7089862d35c47df91214ecc235b44c1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.008200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-060184bd-253e-4094-a442-7df77a58e613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7089862d35c47df91214ecc235b44c1'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.014444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1253/2530] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:45 2022] DELETE /identity/v3/users/a7089862d35c47df91214ecc235b44c1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:46.423895 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:46.425460 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:46.439143 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069f328-d082-4076-931e-312a5c23418d admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:46.486584 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:46.495219 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:46.495848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:46.496135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:46.496438 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] PATH_INFO: `/v3/projects/d752d085e080463998b5bafe5ab0e066` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:46.497556 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d752d085e080463998b5bafe5ab0e066)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:46.499462 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:46.605516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd752d085e080463998b5bafe5ab0e066', 'request_id': 'req-357ffb6a-40ae-4f74-b243-d93641a245e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.611599 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd752d085e080463998b5bafe5ab0e066', 'request_id': 'req-357ffb6a-40ae-4f74-b243-d93641a245e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.706956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd752d085e080463998b5bafe5ab0e066', 'request_id': 'req-357ffb6a-40ae-4f74-b243-d93641a245e4'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.718013 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] The token cache is being invalidate because project d752d085e080463998b5bafe5ab0e066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:15:46.720380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.720380 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-357ffb6a-40ae-4f74-b243-d93641a245e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:46.721017 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1278/2531] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:15:46 2022] DELETE /identity/v3/projects/d752d085e080463998b5bafe5ab0e066 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:46.727077 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:46.727536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:46.727904 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:46.747627 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:46.748882 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:46.806125 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1254/2532] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:46.814905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:46.815195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:46.815470 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:46.835543 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:46.836785 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:46.844705 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1279/2533] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:46.849121 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:46.858683 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf31f-33ea-48a1-8964-3a0060043e11 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:46.863293 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:46.866079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:46.866079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:46.866079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:46.866079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:15:46.866079 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:46.866970 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:46.878803 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1255/2534] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:15:46.883230 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:46.892944 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad492-9a20-47f0-8af0-4a946a9af3fc None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:46.897742 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:46.898335 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:46.898616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:46.898890 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:46.899519 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:46.901454 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:46.985652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1280/2535] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:46 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:46.989841 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:46.999758 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a175-5ab2-44ae-829a-1e042248f0cc admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.050309 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:47.056126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.056751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.057090 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.057365 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.057998 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.059964 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.124126 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1256/2536] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:46 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:47.128830 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.138847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3cb51-cde5-4fee-a62c-0de440d9bb24 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.144090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.144718 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.144993 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.145259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.145897 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.147481 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.157132 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1281/2537] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:47.161229 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.171253 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a47e-0d70-4ff5-9c0c-4a7f3bb2cc08 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.176207 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed0fd-a022-4bc3-b8ea-d0e3fdc2cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.176829 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed0fd-a022-4bc3-b8ea-d0e3fdc2cc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.177113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed0fd-a022-4bc3-b8ea-d0e3fdc2cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.177387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed0fd-a022-4bc3-b8ea-d0e3fdc2cc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.178021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed0fd-a022-4bc3-b8ea-d0e3fdc2cc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.179607 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed0fd-a022-4bc3-b8ea-d0e3fdc2cc94 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.190703 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1257/2538] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:47.194777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.205303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19676c-82f7-43ed-8ba5-c8b7adc51678 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.209907 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.210548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.210832 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.211108 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] PATH_INFO: `/v3/projects/db7664e7090a4bbcbd8dbf65c0895dc2/users/0a379d86ab3f4b6eaba19019f683149f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.225558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7664e7090a4bbcbd8dbf65c0895dc2, user_id=0a379d86ab3f4b6eaba19019f683149f, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.228205 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.290031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1282/2539] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:47 2022] PUT /identity/v3/projects/db7664e7090a4bbcbd8dbf65c0895dc2/users/0a379d86ab3f4b6eaba19019f683149f/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:47.301723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.302114 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.302430 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.330382 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] MFA Rules not processed for user `0a379d86ab3f4b6eaba19019f683149f`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:47.331591 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:47.393702 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1258/2540] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:47.398159 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.459355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacc6ed-887c-4631-aa1c-2763f5505a46 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.464154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.464789 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.465075 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.465344 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.465968 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.467858 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.577068 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1283/2541] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:15:47 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:47.581131 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.591787 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5aafc5-b5c4-4f85-a778-01351c61fdc9 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.646925 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.647517 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.647795 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.648067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.648715 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.650662 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.751963 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1259/2542] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:15:47 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:15:47.755929 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.762795 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:47.766561 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77f3e-076d-4372-9ba7-393e0e8e0285 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.771652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.772330 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.772647 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.772925 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.773565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.775160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.786199 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1284/2543] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:47.790360 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.801130 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6beb9-7d1f-499b-91ff-d254d7cad992 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:47.805769 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:47.806417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:47.806696 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:47.806972 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] PATH_INFO: `/v3/projects/9ae8ec82bf1346e9bdb844dd57b79085/users/24f3484d1f6b42b2af4509119d9e35c6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:47.822608 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae8ec82bf1346e9bdb844dd57b79085, user_id=24f3484d1f6b42b2af4509119d9e35c6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:47.825334 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:47.933750 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1260/2544] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:47 2022] PUT /identity/v3/projects/9ae8ec82bf1346e9bdb844dd57b79085/users/24f3484d1f6b42b2af4509119d9e35c6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:15:47.937792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:47.947777 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682de66-79c4-4b85-be2d-02d7fd014b6f admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:48.003431 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0937ed-d24a-4018-9d38-d7292340ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:48.004031 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0937ed-d24a-4018-9d38-d7292340ecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:48.004318 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0937ed-d24a-4018-9d38-d7292340ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:48.004617 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0937ed-d24a-4018-9d38-d7292340ecf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:48.005250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0937ed-d24a-4018-9d38-d7292340ecf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:48.006842 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0937ed-d24a-4018-9d38-d7292340ecf8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:48.016256 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1285/2545] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:15:48.020932 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:48.031298 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244025ed-a168-4f9e-8bdf-998021098a46 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:48.036471 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:48.037116 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:48.037401 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:48.037695 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] PATH_INFO: `/v3/projects/9ae8ec82bf1346e9bdb844dd57b79085/users/24f3484d1f6b42b2af4509119d9e35c6/roles/a81833492ef64a3aae0d349c9c3c3116` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:48.039860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae8ec82bf1346e9bdb844dd57b79085, user_id=24f3484d1f6b42b2af4509119d9e35c6, role_id=a81833492ef64a3aae0d349c9c3c3116)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:48.042526 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:48.052574 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1261/2546] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:15:48 2022] PUT /identity/v3/projects/9ae8ec82bf1346e9bdb844dd57b79085/users/24f3484d1f6b42b2af4509119d9e35c6/roles/a81833492ef64a3aae0d349c9c3c3116 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:48.117085 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:48.117376 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:48.117657 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:48.146079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] MFA Rules not processed for user `24f3484d1f6b42b2af4509119d9e35c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:48.147304 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:48.214099 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1286/2547] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:48.225874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:48.227566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:48.249411 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:48.288025 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e3e01-bb63-4d55-95d5-8b8aaa50bd77 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:48.292040 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:48.292670 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:48.292953 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:48.293227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:48.348555 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:48.349990 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:48.358646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1262/2548] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:53.398959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:53.400374 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:53.413018 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebdec-331a-44ec-882e-3cabaf7da09d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:53.416894 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6dc20-4e5b-40f4-a163-ee7c2acbc090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:53.417915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6dc20-4e5b-40f4-a163-ee7c2acbc090 service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:53.417915 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6dc20-4e5b-40f4-a163-ee7c2acbc090 service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:53.418127 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6dc20-4e5b-40f4-a163-ee7c2acbc090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:53.426989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6dc20-4e5b-40f4-a163-ee7c2acbc090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:53.428442 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6dc20-4e5b-40f4-a163-ee7c2acbc090 service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:53.437729 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1287/2549] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:15:58.354656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=40 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:15:59.344836 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:59.405355 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a63ba-0b99-4e93-8989-9a3227056b33 service cinder] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:59.409886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:59.410500 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:59.410781 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:59.411050 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] PATH_INFO: `/v3/users/0a379d86ab3f4b6eaba19019f683149f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:59.412144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a379d86ab3f4b6eaba19019f683149f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:59.414083 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:59.582463 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a379d86ab3f4b6eaba19019f683149f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:59.589396 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a379d86ab3f4b6eaba19019f683149f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:59.590060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a379d86ab3f4b6eaba19019f683149f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:59.643379 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a379d86ab3f4b6eaba19019f683149f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:59.659061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a379d86ab3f4b6eaba19019f683149f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:15:59.665732 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1263/2550] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:15:59 2022] DELETE /identity/v3/users/0a379d86ab3f4b6eaba19019f683149f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:15:59.670286 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:59.671710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:59.671710 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:59.691708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:15:59.692971 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:59.752114 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1288/2551] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:15:59.761871 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:15:59.763300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:15:59.819575 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d37d3-1181-4402-acba-6404f42815cb admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:15:59.823249 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:15:59.823851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:15:59.824155 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:15:59.824453 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:15:59.833345 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:15:59.834764 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:15:59.844043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1264/2552] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:00.250784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:00.252312 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:00.260154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=100 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:00.265792 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eea26a-c2b7-4bf6-8a05-724cd7f1194b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:00.270412 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:00.271046 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:00.273908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:00.273908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] PATH_INFO: `/v3/projects/db7664e7090a4bbcbd8dbf65c0895dc2` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:00.273908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7664e7090a4bbcbd8dbf65c0895dc2)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:00.275283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:00.409724 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7664e7090a4bbcbd8dbf65c0895dc2', 'request_id': 'req-5fc0f91e-7953-46da-b38b-df0938e6c0bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.416092 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7664e7090a4bbcbd8dbf65c0895dc2', 'request_id': 'req-5fc0f91e-7953-46da-b38b-df0938e6c0bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.477602 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7664e7090a4bbcbd8dbf65c0895dc2', 'request_id': 'req-5fc0f91e-7953-46da-b38b-df0938e6c0bf'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.487966 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] The token cache is being invalidate because project db7664e7090a4bbcbd8dbf65c0895dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:16:00.488251 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.488899 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.490409 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1289/2553] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:16:00 2022] DELETE /identity/v3/projects/db7664e7090a4bbcbd8dbf65c0895dc2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:16:00.494456 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:00.503956 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527a1d7-f315-4b8b-9cae-54df61b3c4cb service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:00.522571 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:00.560444 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:00.561068 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:00.561352 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:00.561629 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] PATH_INFO: `/v3/users/24f3484d1f6b42b2af4509119d9e35c6` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:00.562743 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f3484d1f6b42b2af4509119d9e35c6)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:00.564694 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:00.737061 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f3484d1f6b42b2af4509119d9e35c6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.744634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f3484d1f6b42b2af4509119d9e35c6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.745290 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f3484d1f6b42b2af4509119d9e35c6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.809458 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f3484d1f6b42b2af4509119d9e35c6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.822864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-339ad960-0f80-45f2-a0e5-3cd8c10fd52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f3484d1f6b42b2af4509119d9e35c6'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:00.828826 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1265/2554] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:16:00 2022] DELETE /identity/v3/users/24f3484d1f6b42b2af4509119d9e35c6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:16:01.230779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:01.232271 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:01.247639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0f91e-7953-46da-b38b-df0938e6c0bf admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:01.304846 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:01.305475 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:01.305756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:01.306028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] PATH_INFO: `/v3/projects/9ae8ec82bf1346e9bdb844dd57b79085` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:01.307140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae8ec82bf1346e9bdb844dd57b79085)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:01.309079 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:01.412255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae8ec82bf1346e9bdb844dd57b79085', 'request_id': 'req-f4648089-e67f-4161-b1d2-f3098827b07a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:01.419233 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae8ec82bf1346e9bdb844dd57b79085', 'request_id': 'req-f4648089-e67f-4161-b1d2-f3098827b07a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:01.503382 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae8ec82bf1346e9bdb844dd57b79085', 'request_id': 'req-f4648089-e67f-4161-b1d2-f3098827b07a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:01.514345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] The token cache is being invalidate because project 9ae8ec82bf1346e9bdb844dd57b79085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:16:01.514633 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:01.515435 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-f4648089-e67f-4161-b1d2-f3098827b07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:16:01.517404 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1290/2555] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:16:01 2022] DELETE /identity/v3/projects/9ae8ec82bf1346e9bdb844dd57b79085 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:16:01.523584 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:01.523996 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:01.524272 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:01.544210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:01.545426 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:01.602923 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1266/2556] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:01.611289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:01.611577 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:01.611855 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:01.631343 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:01.632625 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:01.640360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1291/2557] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:01.644417 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:01.654510 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b466ce-dbef-4636-8c5c-887da583ac3a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:01.659275 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:01.659918 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:01.660202 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:01.660515 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:01.661168 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:16:01.661473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:01.663729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:01.675649 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1267/2558] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:16:01.680110 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:01.689775 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a728d2-90c2-4d94-83c5-e8a32e14db6f None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:01.694511 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:01.695106 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:01.695387 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:01.695662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:01.696320 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:01.698264 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:01.703689 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:01.819956 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1292/2559] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:16:01 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:16:01.824281 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:01.834292 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bc424-2429-4787-ae9e-fbbd3a806d6e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:01.861367 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:01.891356 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:01.891947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:01.892231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:01.892549 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:01.893190 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:01.895134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:01.998336 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1268/2560] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:16:01 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:16:02.002476 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:02.013463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67490ea-baa5-4d3e-b972-fc555bf72b27 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:02.018193 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:02.018790 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:02.019076 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:02.019353 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:02.020028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:02.021659 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:02.032247 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1293/2561] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:16:02.036113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:02.046413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ed83-282e-4554-8a40-e142fbd5ee06 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:02.050979 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1d5f-8ac4-484f-a240-8adcfc0fb2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:02.051693 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1d5f-8ac4-484f-a240-8adcfc0fb2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:02.051981 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1d5f-8ac4-484f-a240-8adcfc0fb2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:02.052258 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1d5f-8ac4-484f-a240-8adcfc0fb2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:02.052929 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e1d5f-8ac4-484f-a240-8adcfc0fb2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:02.054532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e1d5f-8ac4-484f-a240-8adcfc0fb2fe admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:02.065038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1269/2562] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:16:02.069652 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:02.079779 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02409124-de06-441d-828e-dab8a0a71099 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:02.084564 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:02.086015 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:02.086296 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:02.086573 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] PATH_INFO: `/v3/projects/afe5d8b30620426aa0f7ee63ee9829da/users/1fbc2adc111449ef94bc8d9c4f55d9e8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:02.101692 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe5d8b30620426aa0f7ee63ee9829da, user_id=1fbc2adc111449ef94bc8d9c4f55d9e8, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:02.104447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:02.152090 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1294/2563] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:16:02 2022] PUT /identity/v3/projects/afe5d8b30620426aa0f7ee63ee9829da/users/1fbc2adc111449ef94bc8d9c4f55d9e8/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:16:02.157296 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861fde-6699-4e02-966b-7266c8a7b9af None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:02.157595 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861fde-6699-4e02-966b-7266c8a7b9af None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:02.157874 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861fde-6699-4e02-966b-7266c8a7b9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:02.176865 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-d6861fde-6699-4e02-966b-7266c8a7b9af None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:02.178091 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-d6861fde-6699-4e02-966b-7266c8a7b9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:02.236860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1270/2564] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:16:02.246949 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:02.248696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:02.306245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d43520-9a26-49a7-92ba-73a26a01bbab admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:02.309874 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:02.310473 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:02.310754 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:02.311028 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:02.320366 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:02.321818 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:02.331196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1295/2565] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:03.561507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6659b-3ad0-4dfa-890a-2fcc9320b57d None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:03.562051 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6659b-3ad0-4dfa-890a-2fcc9320b57d None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:03.562189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6659b-3ad0-4dfa-890a-2fcc9320b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:03.591421 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-f7d6659b-3ad0-4dfa-890a-2fcc9320b57d None None] MFA Rules not processed for user `1fbc2adc111449ef94bc8d9c4f55d9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:03.593032 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f7d6659b-3ad0-4dfa-890a-2fcc9320b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:03.659586 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1271/2566] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:16:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:03.670923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:03.672336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:03.733893 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f4efe-62b3-4d20-bc9d-0208625256de service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:03.737355 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:03.737953 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:03.738226 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:03.738496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:03.747065 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:03.748516 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:03.758060 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1296/2567] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:16:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:05.682792 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e1c2-9b61-4926-8018-f09adbe7188e None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:05.683227 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e1c2-9b61-4926-8018-f09adbe7188e None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:05.683381 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6e1c2-9b61-4926-8018-f09adbe7188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:05.702532 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-04d6e1c2-9b61-4926-8018-f09adbe7188e None None] MFA Rules not processed for user `1fbc2adc111449ef94bc8d9c4f55d9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:05.703723 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-04d6e1c2-9b61-4926-8018-f09adbe7188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:05.711183 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1272/2568] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:16:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:07.715331 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:07.716756 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:07.777160 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:07.808987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797118ad-31d4-4ad9-80a1-616440dc8abb service cinder] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:07.814070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:07.817847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:07.817847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:07.817847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:07.817847 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:07.828078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:07.829837 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:07.840250 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1297/2569] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:16:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:15.698452 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:17.835963 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=15 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:22.648046 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eae940-1c13-49fd-a7c9-9cc4c225e245 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:22.648581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eae940-1c13-49fd-a7c9-9cc4c225e245 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:22.648682 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eae940-1c13-49fd-a7c9-9cc4c225e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:22.669479 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-57eae940-1c13-49fd-a7c9-9cc4c225e245 None None] MFA Rules not processed for user `1fbc2adc111449ef94bc8d9c4f55d9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:22.670746 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-57eae940-1c13-49fd-a7c9-9cc4c225e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:22.677737 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1273/2570] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:16:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:22.910829 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:22.912284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:22.923877 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dbfda-b243-4523-b79e-2686c922290d service placement] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:22.927620 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:22.928222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:22.928538 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:22.928816 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:22.930523 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:22.939997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:22.941629 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:22.950144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1298/2571] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:16:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:32.663234 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:32.945906 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=6 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:16:40.520238 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ebe5f-72ab-400e-838d-c6d7ccbdac58 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:40.520709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ebe5f-72ab-400e-838d-c6d7ccbdac58 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:40.520885 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ebe5f-72ab-400e-838d-c6d7ccbdac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:40.539864 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-1f8ebe5f-72ab-400e-838d-c6d7ccbdac58 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:40.541085 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-1f8ebe5f-72ab-400e-838d-c6d7ccbdac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:40.603449 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1274/2572] 10.222.0.13 () {58 vars in 1009 bytes} [Fri Oct 14 03:16:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:40.745989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:40.747415 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:40.819975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abe6c1-ba8b-4612-a2ef-57d255f28955 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:40.825480 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0eb6-0609-469a-80b7-4ec7eed2b55c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:40.826153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0eb6-0609-469a-80b7-4ec7eed2b55c service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:40.826484 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0eb6-0609-469a-80b7-4ec7eed2b55c service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:40.826761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0eb6-0609-469a-80b7-4ec7eed2b55c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:40.835178 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0eb6-0609-469a-80b7-4ec7eed2b55c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:40.836786 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0eb6-0609-469a-80b7-4ec7eed2b55c service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:40.844887 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1299/2573] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:16:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 14 03:16:49.307511 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c52e9-c60a-4190-a971-b7fa18d04379 None None] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:49.308415 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c52e9-c60a-4190-a971-b7fa18d04379 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:49.308902 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c52e9-c60a-4190-a971-b7fa18d04379 None None] PATH_INFO: `/` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:49.313378 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1275/2574] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:16:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 14 03:16:49.319997 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff48ef-46e3-4dbc-91d2-4723c1c5b9cb None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:49.320598 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff48ef-46e3-4dbc-91d2-4723c1c5b9cb None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:49.320812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff48ef-46e3-4dbc-91d2-4723c1c5b9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:49.342814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-6fff48ef-46e3-4dbc-91d2-4723c1c5b9cb None None] MFA Rules not processed for user `454ff45f1a974b3c9c46bd066d4e7313`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:49.344479 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-6fff48ef-46e3-4dbc-91d2-4723c1c5b9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:49.351610 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1300/2575] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:16:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:49.371522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c52e9-c60a-4190-a971-b7fa18d04379 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:49.397210 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c52e9-c60a-4190-a971-b7fa18d04379 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:49.401228 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae496bba-82b4-4e1a-b7b1-3bbef10fa871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:49.401831 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae496bba-82b4-4e1a-b7b1-3bbef10fa871 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:49.402280 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae496bba-82b4-4e1a-b7b1-3bbef10fa871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:49.402706 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae496bba-82b4-4e1a-b7b1-3bbef10fa871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:49.411315 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae496bba-82b4-4e1a-b7b1-3bbef10fa871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:49.413056 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae496bba-82b4-4e1a-b7b1-3bbef10fa871 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:49.421485 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1276/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:16:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:49.509262 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b5c04-b844-4c1f-a409-3f391018d548 None None] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:49.509848 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b5c04-b844-4c1f-a409-3f391018d548 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:49.510054 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b5c04-b844-4c1f-a409-3f391018d548 None None] PATH_INFO: `/` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:49.511644 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1301/2577] 10.222.0.13 () {54 vars in 921 bytes} [Fri Oct 14 03:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 14 03:16:49.517825 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44a0a2-6d67-4249-9094-30f02fbbe4cd None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:49.518340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44a0a2-6d67-4249-9094-30f02fbbe4cd None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:49.518796 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44a0a2-6d67-4249-9094-30f02fbbe4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:49.564745 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-ae44a0a2-6d67-4249-9094-30f02fbbe4cd None None] MFA Rules not processed for user `3ec4a4200e034887a5e119c109dea1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:49.566419 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ae44a0a2-6d67-4249-9094-30f02fbbe4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:49.671264 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1277/2578] 10.222.0.13 () {58 vars in 1018 bytes} [Fri Oct 14 03:16:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:16:49.688341 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b5c04-b844-4c1f-a409-3f391018d548 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:49.701463 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b5c04-b844-4c1f-a409-3f391018d548 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:49.707222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:49.708056 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:49.708342 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:49.708687 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:49.725447 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:49.727253 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:49.739892 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1302/2579] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:16:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:16:58.307724 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:58.308188 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:58.308291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:58.328988 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] MFA Rules not processed for user `aac2bc8b15a942438997f94fa9fdf354`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:16:58.330175 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:16:58.337242 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1278/2580] 10.222.0.13 () {58 vars in 967 bytes} [Fri Oct 14 03:16:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:16:58.349245 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:16:58.360316 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db371ab5-58cc-4b64-a1c5-2fc51bdd6759 service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:16:58.365196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972095d3e6cb4472b1c465a780138806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:16:58.365782 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:16:58.366062 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:16:58.366336 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:16:58.374167 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:16:58.376248 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:16:58.384083 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1303/2581] 10.222.0.13 () {60 vars in 1384 bytes} [Fri Oct 14 03:16:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 14 03:17:01.299656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:01.310989 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32172b76-bf74-4948-8ba9-d930f0173ee1 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:01.316150 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:01.316816 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:01.317120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:01.317393 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] PATH_INFO: `/v3/users/1fbc2adc111449ef94bc8d9c4f55d9e8` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:01.318498 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbc2adc111449ef94bc8d9c4f55d9e8)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:01.320420 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:01.491525 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:01.493033 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbc2adc111449ef94bc8d9c4f55d9e8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:01.500708 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbc2adc111449ef94bc8d9c4f55d9e8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:01.501375 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbc2adc111449ef94bc8d9c4f55d9e8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:01.572860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbc2adc111449ef94bc8d9c4f55d9e8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:01.586289 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-8a5f2e44-4606-45b1-bb2d-fb09b644bf29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbc2adc111449ef94bc8d9c4f55d9e8'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:01.592067 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1279/2582] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:17:01 2022] DELETE /identity/v3/users/1fbc2adc111449ef94bc8d9c4f55d9e8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:01.831498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:01.844080 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedde065-8738-4300-94b1-8deb2b751e52 service swift] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:01.902411 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:01.903070 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:01.903352 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:01.903628 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] PATH_INFO: `/v3/projects/afe5d8b30620426aa0f7ee63ee9829da` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:01.904761 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe5d8b30620426aa0f7ee63ee9829da)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:01.906676 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.023831 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe5d8b30620426aa0f7ee63ee9829da', 'request_id': 'req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:02.029955 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe5d8b30620426aa0f7ee63ee9829da', 'request_id': 'req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:02.033552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:02.069982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe5d8b30620426aa0f7ee63ee9829da', 'request_id': 'req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:02.080140 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] The token cache is being invalidate because project afe5d8b30620426aa0f7ee63ee9829da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:17:02.080574 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:02.081717 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-9bf830cb-7c26-40bb-ab6c-591a8364ed2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:02.083244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1304/2583] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:17:01 2022] DELETE /identity/v3/projects/afe5d8b30620426aa0f7ee63ee9829da => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 14 03:17:02.088305 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.088612 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.088886 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.108621 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:02.110490 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:02.173078 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1280/2584] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:17:02.181081 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.181396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.181673 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.201136 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:02.202332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:02.210196 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1305/2585] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:17:02.214634 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.224738 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf3c2d-782a-42f8-9553-cdd4f39366f6 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.229522 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.230108 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.230387 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.230656 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.231291 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:17:02.231589 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.233203 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.245021 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1281/2586] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:17:02.249345 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.258517 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1b2a-3743-4138-8f10-d80add4d955b None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.263153 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.263749 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.264032 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.264313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.264976 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.266878 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.374041 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1306/2587] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:17:02 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:17:02.378098 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.388646 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc524ea-be53-4739-9a95-7864ea67f13a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.445043 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.445673 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.446023 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.446303 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.446931 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.448872 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.533540 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1282/2588] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:17:02 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:17:02.537662 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.547701 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524424-a548-4f73-8a2a-a8257d11c1f1 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.552529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.553117 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.553396 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.553666 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.554302 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.555872 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.565546 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1307/2589] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:17:02.569344 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.579782 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c65bca-5186-455c-891e-b8826f7fb369 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.584313 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ea2c5-4552-4ea5-8a16-d1382eb00909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.584941 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ea2c5-4552-4ea5-8a16-d1382eb00909 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.585220 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ea2c5-4552-4ea5-8a16-d1382eb00909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.585493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ea2c5-4552-4ea5-8a16-d1382eb00909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.586127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ea2c5-4552-4ea5-8a16-d1382eb00909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.587712 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ea2c5-4552-4ea5-8a16-d1382eb00909 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.598930 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1283/2590] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:17:02.602867 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.612772 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1a3f-f87f-4466-b578-c7d39221100c admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.617368 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.618005 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.618284 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.618557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] PATH_INFO: `/v3/projects/828bf583865649eca2fe0488bd9f2f48/users/9879f40eba8846ec9f6fd9f3dd23e0af/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.632864 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828bf583865649eca2fe0488bd9f2f48, user_id=9879f40eba8846ec9f6fd9f3dd23e0af, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.635434 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.710720 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1308/2591] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:17:02 2022] PUT /identity/v3/projects/828bf583865649eca2fe0488bd9f2f48/users/9879f40eba8846ec9f6fd9f3dd23e0af/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:02.721566 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.721863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.722146 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.749214 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] MFA Rules not processed for user `9879f40eba8846ec9f6fd9f3dd23e0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:02.750418 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:02.766933 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:02.814905 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1284/2592] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:17:02.826696 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:02.829064 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:02.885144 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e06069-3c4b-4c0c-baea-ae7b019f3052 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:02.888987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007b326-b387-4e7f-84bc-023bce8f1694 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '921d9ef4dcf94699b5708747fbe0146f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:02.889627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b326-b387-4e7f-84bc-023bce8f1694 service glance] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:02.889909 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b326-b387-4e7f-84bc-023bce8f1694 service glance] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:02.890181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007b326-b387-4e7f-84bc-023bce8f1694 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:02.899332 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007b326-b387-4e7f-84bc-023bce8f1694 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:02.900812 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007b326-b387-4e7f-84bc-023bce8f1694 service glance] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:02.909616 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1309/2593] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:17:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 14 03:17:12.863977 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=19 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:12.905502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:27.485371 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:27.546128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287a4fa-4e28-4813-88e0-2581a6019b70 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:27.552875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:27.552875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:27.552875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:27.552875 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] PATH_INFO: `/v3/users/9879f40eba8846ec9f6fd9f3dd23e0af` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:27.553295 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9879f40eba8846ec9f6fd9f3dd23e0af)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:27.555133 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:27.686860 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9879f40eba8846ec9f6fd9f3dd23e0af'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:27.693986 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9879f40eba8846ec9f6fd9f3dd23e0af'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:27.694661 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9879f40eba8846ec9f6fd9f3dd23e0af'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:27.752185 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9879f40eba8846ec9f6fd9f3dd23e0af'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:27.764949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9879f40eba8846ec9f6fd9f3dd23e0af'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:27.770776 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1285/2594] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:17:27 2022] DELETE /identity/v3/users/9879f40eba8846ec9f6fd9f3dd23e0af => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:27.775311 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:27.775805 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:27.775923 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:27.795283 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:27.796498 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:27.852181 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1310/2595] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:17:27.862550 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:27.863959 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:27.919870 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9df8f5-d0af-419f-8b5b-ca7716c1468a admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:27.923534 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92887066-17ad-45c7-ac31-3a437c6ff7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:27.924165 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92887066-17ad-45c7-ac31-3a437c6ff7cc service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:27.924474 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92887066-17ad-45c7-ac31-3a437c6ff7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:27.924751 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92887066-17ad-45c7-ac31-3a437c6ff7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:27.934639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92887066-17ad-45c7-ac31-3a437c6ff7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:27.936110 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92887066-17ad-45c7-ac31-3a437c6ff7cc service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:27.945663 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1286/2596] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:17:28.331207 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:28.332688 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:28.345313 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd3f7e-d75d-45de-b999-69e593f02a41 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:28.350606 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:28.351405 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:28.351708 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:28.351982 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] PATH_INFO: `/v3/projects/828bf583865649eca2fe0488bd9f2f48` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:28.353154 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828bf583865649eca2fe0488bd9f2f48)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:28.356619 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:28.484668 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828bf583865649eca2fe0488bd9f2f48', 'request_id': 'req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:28.491027 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828bf583865649eca2fe0488bd9f2f48', 'request_id': 'req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:28.557798 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828bf583865649eca2fe0488bd9f2f48', 'request_id': 'req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:28.569014 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] The token cache is being invalidate because project 828bf583865649eca2fe0488bd9f2f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:17:28.569329 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:28.569959 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-65bb2a09-79ce-490c-a2f8-966bf47e0dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:28.571451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1311/2597] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:17:28 2022] DELETE /identity/v3/projects/828bf583865649eca2fe0488bd9f2f48 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:28.577075 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:28.577559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:28.577559 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:28.597863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:28.599048 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:28.615262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:28.658132 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1287/2598] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 14 03:17:28.665716 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:28.666021 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:28.666303 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:28.686398 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:28.687595 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:28.695820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1312/2599] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:17:28.700827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:28.710340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f9605-5985-45f6-bea6-2cfc1e903979 None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:28.715567 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:28.716158 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:28.716477 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:28.716762 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:28.717605 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 14 03:17:28.718071 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:28.720030 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:28.731300 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1288/2600] 10.222.0.13 () {58 vars in 1153 bytes} [Fri Oct 14 03:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 14 03:17:28.735547 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:28.744758 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60073db-0233-4ebb-9245-fff80bea711d None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:28.749389 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:28.749975 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:28.750255 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:28.750529 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:28.751164 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:28.753111 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:28.828558 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1313/2601] 10.222.0.13 () {60 vars in 1153 bytes} [Fri Oct 14 03:17:28 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:17:28.832647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:28.843256 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a4598-5012-49b2-a7cf-f3bbc2cb5b07 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:28.898287 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:28.898896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:28.899181 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:28.899502 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] PATH_INFO: `/v3/users` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:28.900128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:28.902716 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:28.980891 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1289/2602] 10.222.0.13 () {60 vars in 1144 bytes} [Fri Oct 14 03:17:28 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 14 03:17:28.985078 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:28.996227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4eb3c-d1c9-4621-a6b2-01f230e80ec5 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:29.000912 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:29.001539 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:29.001820 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:29.002191 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:29.002835 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:29.004456 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:29.014901 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1314/2603] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:17:29.018711 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:29.028647 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c24b7-a6c7-44f3-93c7-227186ffe7da admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:29.033241 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2246baf-2d11-4ade-8591-45c8be95623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:29.033852 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2246baf-2d11-4ade-8591-45c8be95623a admin admin] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:29.034134 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2246baf-2d11-4ade-8591-45c8be95623a admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:29.034436 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2246baf-2d11-4ade-8591-45c8be95623a admin admin] PATH_INFO: `/v3/roles` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:29.035073 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2246baf-2d11-4ade-8591-45c8be95623a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:29.036698 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2246baf-2d11-4ade-8591-45c8be95623a admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:29.046410 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1290/2604] 10.222.0.13 () {58 vars in 1122 bytes} [Fri Oct 14 03:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 14 03:17:29.050259 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:29.060774 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8a968-7a84-43c5-b1c0-7358aa37fb8e admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:29.065350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:29.065987 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:29.066276 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:29.066548 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] PATH_INFO: `/v3/projects/ebaa1e4295ee4084a217280d331a2357/users/7300399dc9134a259ac7ba1c06f9de95/roles/1ac71e98bd4841a2b2aeef1cd05a59a5` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:29.081545 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebaa1e4295ee4084a217280d331a2357, user_id=7300399dc9134a259ac7ba1c06f9de95, role_id=1ac71e98bd4841a2b2aeef1cd05a59a5)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:29.084151 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:29.145333 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1315/2605] 10.222.0.13 () {60 vars in 1483 bytes} [Fri Oct 14 03:17:29 2022] PUT /identity/v3/projects/ebaa1e4295ee4084a217280d331a2357/users/7300399dc9134a259ac7ba1c06f9de95/roles/1ac71e98bd4841a2b2aeef1cd05a59a5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:29.155839 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] REQUEST_METHOD: `POST` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:29.156128 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:29.156439 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:29.185672 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.auth.core [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] MFA Rules not processed for user `7300399dc9134a259ac7ba1c06f9de95`. Rule list: `[]` (Enabled: `True`). {{(pid=81513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:29.186896 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:29.249349 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1291/2606] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:17:29.261103 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:29.262784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:29.284289 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:29.321057 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf30fa4-4c45-4ece-a95f-e1f67c0df188 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:29.324773 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074918e8-3290-4d3d-85c0-9bec8db23e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '531145399f98493daef67bc1aa803a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:29.330557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074918e8-3290-4d3d-85c0-9bec8db23e1a service cinder] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:29.330557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074918e8-3290-4d3d-85c0-9bec8db23e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:29.330557 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074918e8-3290-4d3d-85c0-9bec8db23e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:29.334244 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074918e8-3290-4d3d-85c0-9bec8db23e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:29.335639 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074918e8-3290-4d3d-85c0-9bec8db23e1a service cinder] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:29.344451 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1316/2607] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:17:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:17:32.340675 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:32.359160 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:32.402524 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f25ec-cb43-4908-989b-8a68f2ade48a None None] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:32.407053 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:32.411127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:32.411127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:32.411127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] PATH_INFO: `/v3/users/7300399dc9134a259ac7ba1c06f9de95` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:32.411127 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7300399dc9134a259ac7ba1c06f9de95)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:32.412113 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:32.578863 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7300399dc9134a259ac7ba1c06f9de95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:32.586405 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7300399dc9134a259ac7ba1c06f9de95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:32.587095 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7300399dc9134a259ac7ba1c06f9de95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:32.650413 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7300399dc9134a259ac7ba1c06f9de95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:32.664709 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7300399dc9134a259ac7ba1c06f9de95'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:32.670729 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1292/2608] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:17:32 2022] DELETE /identity/v3/users/7300399dc9134a259ac7ba1c06f9de95 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:32.677502 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] REQUEST_METHOD: `POST` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:32.678521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:32.678521 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:32.700278 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.auth.core [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] MFA Rules not processed for user `139ae328324b4c2c91733b77c70a8a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 14 03:17:32.703496 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:32.767360 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1317/2609] 10.222.0.13 () {58 vars in 958 bytes} [Fri Oct 14 03:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 14 03:17:32.780536 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:32.781983 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:32.847587 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3670b9-9a0a-46ef-aab2-0aedc70761ca admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:32.851335 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:32.851995 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:32.852278 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:32.852581 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:32.862189 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:32.865144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:32.874148 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1293/2610] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:17:33.297541 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:17:33.299020 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:17:33.311839 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c791ead-d924-4cec-8047-375f3beab031 None None] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:17:33.316932 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:17:33.319605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:17:33.319605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:17:33.319605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] PATH_INFO: `/v3/projects/ebaa1e4295ee4084a217280d331a2357` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:17:33.319605 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebaa1e4295ee4084a217280d331a2357)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:17:33.321195 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:17:33.428158 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebaa1e4295ee4084a217280d331a2357', 'request_id': 'req-fc96dc3e-1028-417c-89bf-b65d1ba8a267'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:33.434468 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebaa1e4295ee4084a217280d331a2357', 'request_id': 'req-fc96dc3e-1028-417c-89bf-b65d1ba8a267'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:33.494203 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebaa1e4295ee4084a217280d331a2357', 'request_id': 'req-fc96dc3e-1028-417c-89bf-b65d1ba8a267'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:33.504989 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] The token cache is being invalidate because project ebaa1e4295ee4084a217280d331a2357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:17:33.506784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:33.506784 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:17:33.507338 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1318/2611] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:17:33 2022] DELETE /identity/v3/projects/ebaa1e4295ee4084a217280d331a2357 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:17:42.869233 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:17:43.501822 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:14.518513 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:14.527340 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d1b82-43a7-4436-9310-47b67b948168 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:14.579193 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:14.579808 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:14.580093 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:14.580369 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:14.582172 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:14.594473 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:14.595974 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:14.604657 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1294/2612] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:18:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:18:14.818958 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:14.823453 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:14.832604 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96dc3e-1028-417c-89bf-b65d1ba8a267 admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:14.836222 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:14.836852 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:14.837130 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:14.837401 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:14.839095 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:14.911745 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:14.913334 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:14.925216 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1319/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:18:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:18:16.104412 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:16.113081 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e402f3-ac26-45ef-bfa4-ba8c55297def service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:16.116639 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '454ff45f1a974b3c9c46bd066d4e7313', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:16.117231 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:16.117507 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:16.117779 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:16.119446 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:16.133149 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:16.134564 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:16.146717 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1295/2614] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:18:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:18:16.889719 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:16.891383 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:16.905082 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bce493-ca14-47f0-9f80-ec20d0397c4d service neutron] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:16.911039 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ec4a4200e034887a5e119c109dea1f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:16.911627 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] REQUEST_METHOD: `GET` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:16.911905 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:16.912175 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:16.913875 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:16.926306 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:16.927814 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:16.938638 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1320/2615] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:18:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:18:25.895301 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:25.896770 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:25.961592 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7fa54-e635-448c-bfcb-0c94d2211782 service neutron] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:25.966094 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:25.966721 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:25.967001 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:25.967274 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] PATH_INFO: `/v3/users/9b0f893d26f44c9d99a8c855de0fa16f` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:25.968514 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0f893d26f44c9d99a8c855de0fa16f)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:25.970487 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:26.135470 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0f893d26f44c9d99a8c855de0fa16f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.143038 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0f893d26f44c9d99a8c855de0fa16f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.143731 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0f893d26f44c9d99a8c855de0fa16f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.196060 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0f893d26f44c9d99a8c855de0fa16f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.209096 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0f893d26f44c9d99a8c855de0fa16f'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.215036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1296/2616] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:18:25 2022] DELETE /identity/v3/users/9b0f893d26f44c9d99a8c855de0fa16f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:18:26.455124 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:26.466101 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567b8e7-c9a0-43e8-987a-41c7e9d35cbb service nova] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:26.523552 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:26.524215 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:26.524531 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:26.524819 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] PATH_INFO: `/v3/projects/459af465b6664bf2b571e931c87c52d6` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:26.525940 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=459af465b6664bf2b571e931c87c52d6)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:26.527871 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:26.625237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459af465b6664bf2b571e931c87c52d6', 'request_id': 'req-353c02a2-6ac4-475a-8cee-1f256bd97e0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.631527 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459af465b6664bf2b571e931c87c52d6', 'request_id': 'req-353c02a2-6ac4-475a-8cee-1f256bd97e0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.693856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459af465b6664bf2b571e931c87c52d6', 'request_id': 'req-353c02a2-6ac4-475a-8cee-1f256bd97e0a'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.705350 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] The token cache is being invalidate because project 459af465b6664bf2b571e931c87c52d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:18:26.705591 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.706237 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:26.707737 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1321/2617] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:18:26 2022] DELETE /identity/v3/projects/459af465b6664bf2b571e931c87c52d6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:18:26.711684 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:26.713120 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:26.728074 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7bd32-5846-4358-a0af-8cea0e083647 admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:26.732900 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:26.784547 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:26.785200 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:26.785484 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:26.785760 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] PATH_INFO: `/v3/users/e5df645c8b674096a8a9b19d736ce5da` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:26.786947 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5df645c8b674096a8a9b19d736ce5da)` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:26.788962 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:26.993506 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5df645c8b674096a8a9b19d736ce5da'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.000262 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5df645c8b674096a8a9b19d736ce5da'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.000949 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5df645c8b674096a8a9b19d736ce5da'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.064878 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5df645c8b674096a8a9b19d736ce5da'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.077009 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.notifications [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5df645c8b674096a8a9b19d736ce5da'} {{(pid=81513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.083493 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1297/2618] 10.222.0.13 () {58 vars in 1224 bytes} [Fri Oct 14 03:18:26 2022] DELETE /identity/v3/users/e5df645c8b674096a8a9b19d736ce5da => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:18:27.557896 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Authenticating user token {{(pid=81512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:18:27.559826 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.fernet_utils [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:18:27.568176 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:27.573908 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c02a2-6ac4-475a-8cee-1f256bd97e0a admin admin] Validating token access rules against request {{(pid=81512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:18:27.630227 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '139ae328324b4c2c91733b77c70a8a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ee22ef683e5495db6f46559187e0847', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:18:27.630856 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:18:27.631135 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:18:27.631408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] PATH_INFO: `/v3/projects/69a91f013252401abf865ffcaea1858c` {{(pid=81512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:18:27.632565 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a91f013252401abf865ffcaea1858c)` {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:18:27.634487 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] RBAC: Authorization granted {{(pid=81512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:18:27.722572 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a91f013252401abf865ffcaea1858c', 'request_id': 'req-188f9f09-ce62-4aa4-8cd3-57d95b340904'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.728946 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a91f013252401abf865ffcaea1858c', 'request_id': 'req-188f9f09-ce62-4aa4-8cd3-57d95b340904'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.784811 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a91f013252401abf865ffcaea1858c', 'request_id': 'req-188f9f09-ce62-4aa4-8cd3-57d95b340904'} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.795461 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] The token cache is being invalidate because project 69a91f013252401abf865ffcaea1858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 14 03:18:27.795752 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.796486 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG keystone.notifications [None req-188f9f09-ce62-4aa4-8cd3-57d95b340904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 14 03:18:27.798501 dv-cinder-801522-13-smb devstack@keystone.service[81512]: [pid: 81512|app: 0|req: 1322/2619] 10.222.0.13 () {58 vars in 1233 bytes} [Fri Oct 14 03:18:27 2022] DELETE /identity/v3/projects/69a91f013252401abf865ffcaea1858c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 14 03:18:37.080017 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:18:37.792408 dv-cinder-801522-13-smb devstack@keystone.service[81512]: DEBUG dbcounter [-] [81512] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 03:21:50.216129 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Authenticating user token {{(pid=81513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 14 03:21:50.217585 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:21:50.284539 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5ecfb-60db-47c2-b3b6-6553f36a016e admin admin] Validating token access rules against request {{(pid=81513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 14 03:21:50.341944 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75afccceda7e4c1692631acb70edce96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '186ad6a443ae4fd4ae201dc2e7541a98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 14 03:21:50.342544 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] REQUEST_METHOD: `GET` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 14 03:21:50.342827 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] SCRIPT_NAME: `/identity` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 14 03:21:50.343101 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 14 03:21:50.344851 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.fernet_utils [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 14 03:21:50.356144 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 14 03:21:50.357761 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c87e6d-e996-431b-87a5-41913805d728 service placement] RBAC: Authorization granted {{(pid=81513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 14 03:21:50.368036 dv-cinder-801522-13-smb devstack@keystone.service[81513]: [pid: 81513|app: 0|req: 1298/2620] 10.222.0.13 () {60 vars in 1365 bytes} [Fri Oct 14 03:21:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 14 03:22:00.363199 dv-cinder-801522-13-smb devstack@keystone.service[81513]: DEBUG dbcounter [-] [81513] Writing DB stats keystone:SELECT=58 {{(pid=81513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}